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ABSTRACT 


The practice of including illustrations with the 
text of most reading material for elementary school 
children needs to be evaluated in terms of its usefulness 
to the reader. Existing research evidence regarding the 
effects of pictures on children's reading comprehension 
is inconclusive. Thee is, pictures may or may not facili- 
tate comprehension. This study sought to further investi- 
gate the differences, if any, in children's reading 
comprehension of written discourse when illustrations were 
included with a text and when they were not. 

The sample consisted of 60 grade four children 
from the Edmonton Public School System. Thirty of these 
subjects, whose percentile rank on the paragraph meaning 
subtest of the Stanford Achievement Test was ator above 75 
were defined as good readers. Thirty subjects, whose per- 
centile rank was at or below 250n the same test, were defined 
as poor readers. 

To secure the desired information, each subject was 
first asked to read either an illustrated or an unillus- 
trated copy of the children's storybook Caps for Sale. 
Fifteen subjects from each reading group read the illus- 
trated version and 15 read the unillustrated version. Each 
subject was then given the Rystrom Reading Comprehension 
Test, an instrument based on the text of the storybook. 


The test consists of 57 multiple-choice questions dealing 
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with vocabulary, syntax, item recall, item sequence, 
interpretation, and evaluation. 

Subjects' total comprehension and subtest compre- 
hension scores were computed and analyzed by the two-way 
analysis of variance statistical procedure. The signifi- 
cance of the treatment main effect and of the interaction 
between level of reader and treatment given were tested for 
total test comprehension and for subtest comprehension. 

The results indicated that the inclusion of illus- 
trations in children's reading material did not signifi- 
cantly affect total test comprehension. Vocabulary, item 
recall, item sequence, interpretation, and evaluation 
comprehension were not significantly affected, either, 
although subjects in the picture condition did perform 
better on twelve of the fourteen sets of group means. 
Comprehension on the syntax subtest was significantly 
higher when the illustrated version of the story was used. 
Concerning the interaction between level of reader and 
treatment given, results indicated that good readers and 
poor readers were not differentially affected by illus- 
trations on any of the measures tested. 

Several implications arising from the findings may 
be of particular interest to classroom teachers and pub- 
lishers of children's reading materials. In addition, 
this study raised several questions and suggested areas 


worthy of further investigation. 
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Chapter 1 
PURPOSE OF THE STUDY 


Even the most cursory examination of EnsGeHooks 
and textbooks written for lower and middle elementary 
school children reveals the prevalence of illustrations. 
In most instances, the illustrations are adjuncts to the 
written discourse, in that the text should be comprehended 
even when the illustrations are removed. Because most 
illustrations are used in this way it is important to know, 
specifically, if they do play a role in children's reading 
comprehension. 

With reference to the widespread practice of 
including pictures in children's reading material, Chall 
(1967) found that, in general, children's textbook authors, 
publishers, and school administrators, defended — 
educational decision on emotional grounds rather than with 
sound pedagogical reasoning. Authors perceived that 
teachers wanted pictures included in children's books. 
Chall indicated that one author felt that teachers had 
not, in fact, clearly considered why they preferred to 
use texts having accompanying illustrations. That author 
stated that "illustrations are an important selling point 
for teachers. Teachers can't select readers on important 


criteria so they use irrelevancies, like illustrations" 
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(Chall, 1967, p. 70). Another point made by several 
authors was that competition from other publishers kept 
them from cutting down on illustrative content. Authors 
also claimed that there was little evidence to suggest 
that pisenees detract from the learning to read process, 
or that they enhance it. 

It appears that illustrations are included in 
children's books for commercial reasons rather than for 
their possible pedagogical value. Whether illustrations 
have value in furthering children's reading comprehension 
is an issue that has not been fully explored. It is the 
Purpose of this "study to attempt further clarification of 


this question. 
STATEMENT OF THE PROBLEM 


The major problem investigated in this study was 
the determination of the differences, if any, in children's 
comprehension of written discourse when illustrations were 
included with a text and when they were not. Specifically, 
the problemwas to determine if there were significant 
differences in the total reading comprehension scores of 
subjects when they read the illustrated or unillustrated 
version of the children's storybook Caps for Sale by Esphyr 
Slobodkina, when comprehension was measured by total scores 


on the Rystrom Reading Comprehension Test. Furthermore, 


two sub-problems were investigated: (1) Were there 
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significant differences in the subtest comprehension scores 
of subjects when they read the illustrated or unillustrated 
version of Caps for Sale, when comprehension was measured 
by subtest scores on the Rystrom Reading Comprehension 
Test? cand (2) Were the reading comprehension scores of 

good versus poor fourth grade subjects differentially 
affected when they read the illustrated or unillustrated 
version of Caps for Sale, when comprehension was measured 
by total scores and subtest scores on the Rystrom Reading 


Comprehension Test? 
DEFINITIONS 


A number of terms which have meaning specific to 
this study are defined as follows: 

1. Reading Material: refers specifically to the 
children's storybook Caps for Sale by Esphyr Slobodkina, 
£97.03 

2. Illustrations: refers to the coloured illus- 
trations drawn by the author of Caps for Sale and included 
with the regular edition of the storybook. This term was 
used interchangeably with the term "pictures." 

3. Total Reading Comprehension: refers to sub- 
jects' total scores on the Rystrom Reading Comprehension 
Test (Experimental Edition, September, 1969). 

4. Subtest Comprehension: refers to subjects' 


scores on the six subtests of the Rystrom Reading 
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Comprehension Test, which included vocabulary, syntax, item 
recall, item sequence, interpretation, and evaluation. 

5. Good Readers: refers to grade four subjects whose 
percentile rank on the paragraph meaning subtest of the 
Stanford De ee Test, administered in April-May, 1974, 
was at or above 75 using grade three school system norms. 

6. Poor Readers: refers to grade four subjects whose 
percentile rank on the paragraph meaning subtest of the 
Stanford Achievement Test, administered in April-May, 1974, 


was at or below 25 using grade three school system norms. 
RESEARCH QUESTIONS 


For the purpose of this investigation the four 
research questions below were devised. Null hypotheses 
were developed in order to carry out the tests for 
statistical significance. The research questions and 


their corresponding null hypotheses are as follows. 


Research Question I 

Will there be significant differences in the total 
reading comprehension scores of good and poor Eourth grade 
readers when they read the illustrated or unillustrated 
version of the children's storybook Caps for Sale by Esphyr 
Slobodkina, when comprehension is measured by total scores 
on the Rystrom Reading Comprehension Test? 


Null Hypothesis I. There will be no significant 
difference between picture and no-picture 
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group means for total reading comprehension 
on the Rystrom Reading Comprehension Test. 
Research Question II 
Will there be significant differences in the sub- 
test Ponpeeneneion scores of good and poor fourth grade 
readers when they read the illustrated or unillustrated 
version of the children's storybook Caps for Sale by Esphyr 
Slobodkina, when comprehension is measured by subtest 
scores on the Rystrom Reading Comprehension Test? 
Null Hypothesis 11. There will be no significant 


differences between picture and no-picture 
group means for subtest comprehension on the 


Rystrom Reading Comprehension Test. 

Research Question III 

Will the total reading comprehension scores of good 
versus poor fourth grade readers be differentially affected 
when they read the illustrated or unillustrated version of 
the children's storybook Caps for Sale by Esphyr Slobodkina, 
when comprehension is measured by total scores on the 
Rystrom Reading Comprehension Test? 


Null Hypothesis III. There will be no interaction 
between level of reader and treatment given 


for total reading comprehension on the Rystrom 
Reading Comprehension Test. 


Research Question IV 
Will the subtest comprehension scores of good 


versus poor fourth grade readers be differentially 
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affected when they read the illustrated or unillustrated 
version of the children's storybook Caps for Sale by Esphyr 
Slobodkina, when comprehension is measured by subtest 
scores on the Rystrom Reading Comprehension Test? 
Null Hypothesis IV. There will be no interaction 
between level of reader and treatment given 


for subtest comprehension on the Rystrom 
Reading Comprehension Test. 


LIMITATIONS 


This study was subject to certain limitations 
arising from decisions made in the initial planning of 
the investigation. 

1. The Rystrom Reading Comprehension Test was an 
experimental version of a reading comprehension instrument. 
Data have been recorded on its reliability and validity 
(Rystrom, 1970a, 1970b) but no norms for the instrument 
are presently available. As well, several of the subtests 
include limited numbers of items and the findings from 
these are necessarily limited in generalizability. 

2. The Rystrom Reading Comprehension Test was 
not altered for this investigation. Whatever the possible 
weaknesses regarding particular items and/or subtests, no 
changes were made prior to the present use of the test. 

3. The multiple-choice format of the comprehension 


instrument was subject to the weaknesses inherent in such 


a measuring device. 
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4. The sample for this study was chosen from 13 
grade four classrooms in the Edmonton Public School evete 
and therefore generalizability of the results is necessarily 
limited. 

5. The subjects' previous instruction eencernina 
the use of pictorial content when reading was not accounted 
for or investigated, therefore the influence of any prior 


instruction in this area could not be measured. 
ASSUMPTIONS 


The null hypotheses tested in this investigation 
were based upon the following assumptions: 

1. That the most recent paragraph meaning scores 
on the Stanford Achievement Test accurately defined sub- 
jects' present reading comprehension levels. 

2. That all administrations and scorings of the 
Stanford Re eveneae Test followed the standardized pro- 
cedures outlined for the test. 

3. That the present experimental setting and 
administration would not interfere with subjects' compre- 
hension of the reading material. 

4. That subjects would respond honestly regarding 
previous exposure to the reading material used in the study. 

5. That the Rystrom Reading Comprehension Test 
was an appropriate instrument to investigate the problems 


outlined in this study. 


4 


€1' wex> cence! as, berte: stets tor) 4 
maseye, Luadok oie temepe mer enn | ts wee t 
yi dvevesapen, 25 24 toast siks goysiied 3 

‘ ; 

pItAseT a: nod aAvidounisads HQIV9sS. . 
badiosans tog saw pebie a eat Sar TKCD 

yOi7g wrs. te. soneut ink Ota wrodonait ‘ 


Acieagisneveas 423 vc Leese atcodteqel et Taga hd uo 
| seis mda  pintwale ee wah sou Sate om 
senove pai neen das-tpas st J nse vy wi oO ol 


r 
: 


IMPORTANCE OF THE STUDY 


Studies which have investigated the effects of 
illustrations on children's reading comprehension have 
generally produced either inconclusive or contradictory 
results, suggesting a need for further research in this 
area. 

Research in the 1930's through the 1950's tended 
to deal rather globally with reading comprehension, as it 
was related to illustrated and unillustrated reading 
material. Moreover, many of the measures of reading 
comprehension were open to question. In response to this, 
studies in the 1960's and 1970's attempted to make the 
measure of comprehension more specific. In a continued 
effort to measure reading comprehension explicitly, the 
present study investigated six areas of reading compre- 
hension as defined by the Rystrom Reading Comprehension 
Test: vocabulary, syntax, item recall, item sequence, 
interpretation, and evaluation, to determine the possible 
influence of illustrations on these particular aspects of 
comprehension. 

A further concern of this study was to ascertain 
whether the reading comprehension of good readers and poor 
readers was affected differentially when illustrations were 
included with textual material. If differences were noted, 
this would suggest that instructional procedures as they 


relate to the use of illustrations may need to be examined. 


vestuibeuSnos. 20 avieg Sante J snaithe ‘aaa 
Pa 1) (ochees2 “TeeyN 292 \Geam i ad 


baehnat 2 ara end dauozs e’*Of£°*. a4 ‘7 daheoten: fal 
$t #6 cp heneetemrow ced bbaen cate vi tesone qod3e% 898 OF 
eh Cees Bebeed ir Chia ee bevesteu Ee os badetes 4 


piihse: 2 gstreced SR? to Ydae Veovae io a lattes 


tides ct seqseke? of salddey 03 a9q0 ere 4 


oe Ae Sire 
of? eAsm oF Sadeamste a OTs baa | fF “gaes emi of ow “a 


puri tgon ent cl tewge siee potasedoongans Xo hose 
. a i 

ead ,Uktinkiecses nakengt estan Bd ond bens” atk 

-Ssqmos yetines i = Ate Saaapsteyinr, 


— pa 
= 


we sera sprshiaag wads We ‘Srolonsinctts to. 
} 


zetamsen Of aw Ybute sigs te oxe3920 ee 


a) hers Ge! 


a erotaensaustt ache pence hii cstbe tale q 


otek tetsu Louch iy om Fonsi 
pla tan +ani3 veapaue" ve | } 


sibontanes od, og hana “:: eae Fo 220, 68g, 02 ‘s 


Apart from the theoretical concerns, if the study 
showed that illustrations did not help children perrar 
understand textual material, it could be argued at a more 
practical level that materials for reading instruction 
might be produced more inexpensively in the future = 


omitting the illustrations. 
OVERVIEW OF THE STUDY 


Chapter 1 has dealt with the purpose of the study. 
It included a statement of the problem and sub-problems 
to be investigated; the definitions of the terms used; the 
research questions and corresponding null hypotheses 
examined and tested; the limitations of the study; the 
assumptions underlying the study; and the importance of 
the present research. 

Chapter 2 presents a review of the literature and 
research anich gave direction to the present study. 

Chapter 3 includes a description of the design 
of the study: the population, the sample, the instrument 
used, the collection and treatment of the data, and the 
statistical procedures employed. 

Chapter 4 consists of an analysis of the data and 
a summary of the findings related to the research questions 
asked and the null hypotheses tested. 

Chapter 5 includes a final summary of the study and 


conclusions arising from the findings. Implications and 
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suggestions for further research are also given in this 


chapter. 
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Chapter 2 
REVIEW OF RELATED RESEARCH 


Some authors, notably those in the field of lin- 
guistics (Bloomfield and Barnhart, 1961; Fries, 1966), 
have questioned the utility of including illustrations in 
material designed to teach children to read words, and 
have accordingly published school textbooks without illus- 
trations. However, most children's reading materials do 
contain illustrations and this practice has not been 
seriously questioned by many educators. Research evidence 
is available concerning the effects of pictures on learning 
and, according to Samuels (1970), falls into three main 
areas: the effects of pictures on learning to read, the 
effects of pictures on comprehension, and the effects of 
pictures on attitudes. The present study dealt eee 
cally with the second concern: the effects of pictures on 
comprehension. The following review of the research, 
therefore, involves those studies which focus on the 
effects of pictures on reading comprehension, especially 


at the elementary level. 


STUDIES DEALING WITH THE EFFECTS OF PICTURES 
ON READING COMPREHENSION 


The research reported here is presented and 


analyzed in chronological order since investigators in this 
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' area have themselves attempted, for the most part, to build 
upon previous studies and have developed increasingly more 


sophisticated research designs. 


Studies in the 1930's and 1940's 

As early as the 1930's there is evidence that 
educators were questioning the value of including illustra- 
tions in materials used for teaching reading as a subject 
area. The early studies (Goodykoontz, 1936; Miller, 1938), 
however, were very loose in design, thus limiting their 
interpretation. 

While Goodykoontz did not deal directly with 
effects of illustrations on reading comprehension, her 
evidence suggested that pictures could supply information 
to a reader in a way that could enhance comprehension. 
Goodykoontz' grade six to grade eight subjects were pre- 
sented with an illustrated booklet and, after having read 
it, were required to answer 26 questions: 13 dealing with 
the text alone and 13 dealing with the pictures alone. The 
subjects answered an average of nine of the 13 text ques- 
tions accurately whereas they answered an average of only 
four of the 13 picture questions correctly. Goodykoontz 
suggested that these differences could be explained, in 
part, by the fact that subjects did not always attend to 
the pictures. (She reported that 6% of the subjects did 
not appear to look at the pictures at all’) “In -a®second 


part of the study, Goodykoontz presented the same 
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illustrations, without the text, to grade six subjects in 
an attempt to determine whether pictures alone could eee 
vide information to children. When presented with only the 
illustrations, subjects answered an average of eight of the 
13 questions correctly. Goodykoontz concluded that when 
pictures are the only source of information they can pro- 
vide almost as much information as textual material. If 
pictures do indeed provide children with information, this 
suggests that illustrations might be included in children's 
reading materials for the purpose of providing information 
which reinforces the text or is supplementary to it. 
Goodykoontz' observation that some subjects seemed 
to ignore the illustrative material was taken into account 
in the present study, in that the investigator did try to 
determine whether or not subjects attended to the ieget ta 
tions while reading the textual material used here. 
Miller's (1938) study came closer to a a oneonved 
experimental study of the influence of illustrations on 
children's reading comprehension. He had 600 grades one, 
SoS. and three children use primary basal readers with and 
without illustrations. One hundred subjects in each grade 
read illustrated stories from the basal readers and one 
hundred read the same stories in which the illustrations 
were covered. Subjects were assigned to the two groups on 
the basis of their matched reading scores on a standardized 


reading test given prior to the experiment. Miller first 
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tested his subjects' reading comprehension of three illus- 
trated or three unillustrated stories from the basal | 
readers, and, after they had used the readers, illustrated 
or unillustrated, for an entire semester, he gave another 
reading compehension test. Miller reported no eee eeically 
significant differences in the reading comprehension of the 
groups either after reading three stories or after com- 
pleting the primary basal readers. Unfortunately, while 
Miller's results are interesting, there were several 
limitations in the design of his study which must be con- 
Sidered in interpreting his results. Miller did not 

report any details about the specific nature of the 
mMaterials—he only referred to them as primary basal 
readers. Second, children reading the illustrated and 
unillustrated texts were often in the same classrooms. It 
is obvious that either group would have had some access to 
the reading eres of the other group and ie might 
have contaminated Miller's results. Also, several of 
Miller's measures of comprehension were unique to his 
study. For instance, children were asked to identify a 
word spoken by the teacher from a printed group of words, 
to choose from two printed phrases the phrase spoken by 

the teacher, and to delete the extraneous word from a group 
of three words. The first two measures involve word 
recognition and the latter measure, although requiring 


meaningful associations among words, does not directly 
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' focus on the comprehension of a given passage. Miller also 
required subjects to complete unfinished sentences after 
reading a related paragraph, and to put the happenings in 
a paragraph into proper sequence. Both of these measures 
have greater generalizability as measures of reading 
comprehension than do the first three, however Miller 
included no examples of his questions, thereby making a 
complete analysis difficult. Thus, although Miller did 
question the influence of illustrations on children's 
reading comprehension and was one of the first to experi- 
mentally test his suspicions, one needs to be cautious 
about generalizing from his findings. 

Halbert (1944) investigated the effect of pictures 
on the recall of relevant ideas from a story. Two hundred 
and ninety-four subjects, aged 8 1/2 to 12 years, read 
illustrated and unillustrated stories and were required to 
retell them as accurately as they could. Their responses 
were evaluated, in part, according to the number of rele- 
vant ideas each subject could state. Relevant ideas were 
previously defined by Halbert as summary statements and 
descriptions of details, events, and/or principles. Sub- 
jects in the text-plus-pictures groups produced more 
relevant ideas than subjects in the text-only groups. As 
well, good and average readers gave more relevant 
responses than did poor readers. Again, as ‘e the case 


of Miller's study, a major problem in interpreting the 
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-results rests in the limited information provided about the 
actual measures of comprehension and about the role of the 
pictures in the materials used. For example, were the 
pictures adjuncts to the textual material or did they more 
fully emphasize the message of the author? And did the 
examiner focus upon relevant ideas which would be enhanced 
by the illustrations and which might not have been so 
obvious in the text alone? 

In the present study, each of the pictures is 
clearly an adjunct to the textual material. Since the test 
questions were devised for the unillustrated text, there 
was no question about the illustrations affecting the 
nature of the questions asked. In other words, subjects 
reading the illustrated version were in no way at an 
advantage on the basis of selectivity of questions. 
Halbert's findings regarding differences among good readers 
and poor readers led the present investigator to consider 


those differences in the present study. 


Studies in the 1950's 

Vernon carried out two studies, one in 1953 and 
one in 1954, that dealt with the value of illustrations 
included with textual material. Vernon (1953) investigated 
whether pictures helped or hindered the acquisition of 
knowledge from a text. Two short articles were prepared, 
with two versions of each; one version accompanied by 


photographs and the other by graphs. After reading a 
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. version of each article, the 62 subjects were asked to 
recall orally what the stories had been about and their 
reports were scored by the numberof major points and 
details remembered and for their general coherence and 
logical consistency. The number of points remembered was 
not significantly different whether subjects read the 
pictorial or non-pictorial versions of the articles. 

Vernon did find, however, that certain major points in the 
texts were better recalled by the picture group. For 
example, a picture of a slum caused many subjects to remark 
on the evils of slum housing. While pictures aided the 
recall of some points, they did not assist readers in 
remembering the explanatory and relational statements 
present in the articles nor did they affect the consistency 
and coherence of the responses. Vernon concluded that 

", . . the pictures had little effect one way or the other 
in helping the reader to gain a real understanding of what 
he read" (p. 186). 

The first part of Vernon's 1954 study questioned 
whether pictures added to subjects' knowledge and under- 
standing of material designed to instruct. Subjects were 
11 and 12 years old and the reading material consisted of 
short (700-900 words) expository passages. Subjects were 
asked general questions after reading an illustrated ver- 
sion of one passage and an unillustrated version of 


another. The results suggested that the pictures did not 
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assist significantly in the understanding of the passages. 
Vernon stated that the material may have been too difficult 
for the subjects to assimilate and that they may have tried 
to memorize the text, a procedure which would not help them 
to answer general questions. 

Although some of Vernon's comprehension measures 
were Similar to Halbert's, she found that pictures did not 
necessarily facilitate the recall of ideas. Her material 
was designed to instruct and thus was probably more similar 
to the textbook material children deal with at school. But 
Vernon did suggest that this material may have been diffi- 
cult for her subjects to assimilate. This suggestion led 
the present investigator to consider carefully the match 
between reading material grade level and subjects" grade 
level in the present study. 

Vernon's work suggested, as well, that certain 
measures of reading comprehension might be differentially 
affected by illustrations included with textual materials. 
The present study continued to investigate this finding by 
measuring picture influence on six defined areas of reading 


comprehension. . 


Studies in the 1960's and 1970's 

A survey of studies from the 1930's through the 
1950's indicated that comprehension measures needed to be 
clearly defined, purposes for the written materials and for 


the included pictures elucidated, and firm experimental 
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_ controls and statistical analyses continued. The more 
recent studies of Weintraub (1960), Koenke (1968), roeaken 
and Otto (1969), Pederson (1970), and Bluth (1972) are 
discussed here in relation to these points. 

Weintraub (1960) and Koenke (1968) made the measure 
of comprehension more explicit by focussing on readers' 
abilities to give the main thought or main idea of a passage 
Since this might be especially affected by illustrations. 

Weintraub (1960), using good readers from three 
grade three classes, exposed each subject to (1) a short 
story without pictures, (2) a short story with pictures, 
and (3) pictures alone. He then measured what he defined 
aS main idea responses under each condition. Weintraub's 
questions dealt with movements, descriptions, and reasons 
for characters' actions. He used texts and illustrations 
as they appeared in a published reading series and thus did 
not directly control the relationship between text and 
pictures. Weintraub concluded that children comprehend a 
main idea best in the text-only condition. The text-plus- 
pictures condition was next best and the pictures condition 
last. Koenke (1968) questioned Weintraub's statistical 
analyses and stated that the means of the groups in the 
text-only condition and in the text-plus-pictures condition 
were not significantly different. Despite these contra- 
dictory interpretations of the results, in either case, 


the conclusion is that illustrations do not enhance a 
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reader's ability to state the main idea of a passage. At 
best, they allow subjects using text plus pictures to make 
a main idea statement only as well as subjects using the 
text alone. 

Weintraub's study suggested that even if a research- 
er did clearly limit and define the measure of reading 
comprehension investigated, he or she still might not find 
that illustrations included with texts would improve that 
measure of reading comprehension. The present study, by 
expanding the investigation of reading comprehension to 
six defined areas attempted to provide some evidence that 
illustrations could improve reading comprehension in one 
or more of these particular areas. 

Koenke (1968) attempted to improve Weintraub's 
(1960) study by designing his own main idea paragraphs 
and by defining and constructing main idea pictures to 
include with the texts. Koenke noted Goodykoontz' (1936) 
finding that 6% of her subjects did not look at the 
pictures at all, and so devised a picture treatment in 
which grade three and grade six subjects who were exposed 
to pictures received either (1) no direction to view the 
pictures, (2) minimal direction, or (3) maximal direction. 
His 240 subjects were required to state the main ideas of 
three pictures, or three paragraphs (each four sentences 
long), or three paragraphs plus content-relevant pictures. 


Koenke noted Vernon's (1954) comments regarding the effect 
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. that the difficulty of the reading material had on subjects’ 
responses. He controlled for this by having half of the 
subjects in the text and text-plus-picture conditions read 
three basic paragraphs set at a grade one reading level and 
the other half of the subjects read three buedgvapnseat 
their grade placement (three or six) level. Responses 

were measured on a seven point scale and rated by three 
trained judges. Koenke found that exposure to a content- 
relevant picture did not enhance main idea responses nor 
did directions to viewthe pictures do so. The main idea 
responses of the grade six subjects were significantly 
better on the grade one paragraphs than on the grade six 
paragraphs. Grade three subjects did not respond signifi- 
cantly better on grade one paragraphs than on their grade 
placement paragraphs. This suggested that the simplifica- 
tion of the reading material was more successful in 
improving subjects' responses than were the pmrnstrasion 

or direction treatments. Koenke's work suggested that even 
when the illustrations included with textual materials 

were purposively defined, they might not affect a reader's 
comprehension of those reading materials. 

Koenke's findings that direction or lack of direc- 
tion to view the illustrations made no statistical differ- 
ence to reading comprehension led the present investigator 
to consider using uniform directions for all subjects in 


the study, and not to give a specific set of instructions 
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_to the picture groups alone. Koenke's significant 
findings regarding simplification of the reading material 
suggested that the reading material used in the present 
study should offer even poor readers in grade four the 
advantage of using reading material below their oniae 
grade level. 

In an attempt to improve on his 1968 study, 
Koenke, with the help of Otto (1969), devised another main 
idea experiment. They used longer reading passages, more 
like commercial reading materials, and black and white 
pictures which they defined as either specifically or 
generally relevant to the main ideas of the passages. 
Subjects from grade three and grade six read passages cal- 
culated to be at a fifth grade readability level. Each 
subject read three passages, each having a different format. 
Each saw a specifically relevant picture included with a 
passage, a generally relevant picture plus eee gonad 
passage only. Main idea responses were assigned a value 
of one to five and evaluated by three trained judges. 
Koenke and Otto found that pictures were not of value to 
the grade three subjects. They stated that decoding 
problems probably kept these subjects from making use of 
the pictures, a result closely related to Koenke's (1968) 
findings concerning readability level. Grade six subjects 
had significantly higher scale ratings when pictures were 


present, whatever the type of picture included. However, 
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the authors stated that, generally, these subjects failed 
to understand the "gist" of the passages and tended to 
fixate on a single word or concept which was depicted in 
both types of pictures. They suggested that the material 
may have been too complex even for grade six subjects to 
find the main idea. 

These results appeared contradictory to those 
found by Koenke in 1968. The difference was mainly a 
matter of interpretation. Although subjects had higher 
ratings when illustrations were present (in the 1969 
experiment), their responses were not yet main idea 
responses. Illustrations perhaps pointed readers in the 
direction of a desired response but they could not ensure 
that this response would be complete and fully accurate. 

Since the present study looks at a number of 
aspects of comprehension, and not just main idea, it may 
be found that illustrations lead subjects to respond more 
accurately in certain areas of reading comprehension, for 
example, in the areas of vocabulary, item recall, and 
interpretation. 

Research up to the 1970's on the effects of illus- 
trations on children's reading comprehension had, for the 
most part, focussed on ill-defined or inadequate measures 
of comprehension. Pederson (1970) attempted to broaden 
the scope of previous comprehension measures by testing 


selected literal and inferential comprehension skills 
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from Barrett's Taxonomy. Her measures of literal compre- 
hension were: the recognition of details, main ideas, 
sequence, comparisons, cause and effect relationships, and 
character traits. Inferential comprehension included all 
of the above measures except the inferring of details. 
Pederson used five literal and five inferential questions 
for each reading passage. However not all of the types of 
literal and inferential skills were measured for every 
story, and Pederson did not include a breakdown of the 
number of questions asked for each skill. Since she asked 
so few questions it was difficult to derive satisfactory 
conclusions regarding the influence of pictures. As well, 
the inferential questions were multiple-choice and limited 
the subjects to the alternatives stated, a limitation also 
found in the present study. 

Pederson noted a paucity of research in this area 
in which subjects' reading levels were controlled, so she 
chose subjects who were reading at one, one and one-half, 
and two years below grade placement. During the first 
week of Pederson's study, 30 poor grade three readers 
read three stories at their reading level from a published 
reading series, with the illustrations intact. In the 
second week, these subjects read three different stories 
at the same level and from the same series, from which 
the illustrations had been removed. Another 30 poor 


readers were exposed to the reading materials in the 
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reverse order. Pederson found no statistically significant 
differences in the overall means during the two weeks 
whatever the order of presentation or reading level of the 
subjects. 

Pederson's results indicated that pictures did not 
improve the reading comprehension of low readers. It may 
be that the illustrations added no new information or no 
information pertinent to the questions being asked. Or 
subjects may not have known how to get information from 
the pictures. 

The present study attempted to build upon Pederson's 
by also selecting several comprehension skills to measure. 
In addition, the readability of the material to be read 
was considerably below all subjects" attained grade level. 
Furthermore, good readers as well as poor readers were 
exposed to the same reading material in an attempt to 
measure any differential effects that illustrations might 
have’ on their reading comprehension. 

A study by Bluth (1972) examined reading compre- 
hension using the cloze technique. Eighty good readers 
and poor readers in the second grade read two different 
passages, each 125 words in length, from which every fifth 
word had been deleted. Inserted words were scored correct 
if they were exact replacements of the deleted words. One 
passage was presented consistently with a picture and the 


other without. Information was not available as to the 
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nature or reading level of the passages or about the 
relationship of the illustration to the passage. geod 
readers responded significantly better on the test when 
it was illustrated. With poor readers the response differ- 
ences were not significant. | 
Bluth's study presents findings which need replica- 
tion as the cloze measure of comprehension is a type of 
response format not previously used by researchers 
investigating this problem. A partial explanation of 
Bluth's results could be that good subjects were chosen 
from the top three stanines of a standardized reading 
achievement test and poor subjects were selected from the 
lowest three stanines. Poor subjects may have been so 
penalized by word recognition weaknesses that their under- 
standing of the test format may have been minimal. The 
present study sought to alleviate possible word recognition 
difficulties by supplying the pronunciation of ae words 


unknown to the subjects. 
SUMMARY 


The intent of this survey of research studies from 
the last forty years dealing with the influence of illus- 
trations on reading comprehension was to show the extent 
of the investigations and to glean insights from the 
findings. Although it appeared that illustrations did not 


significantly aid comprehension, it was impossible to claim 
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that eed had no influence. 

Further research needs to be done on picture 
influences on reading comprehension when illustrations 
are not used as adjuncts to the reading material. The 
present study continued to use adjunctive-type illustra- 
tions. 

Comprehension measures still need further explora- 
tion. For instance, Pederson's (1970) study might be 
duplicated with the inclusion of more questions for each 
area of comprehension. Or a test measuring numerous 
comprehension skills could be designed and possible differ- 
ential effects of illustrations upon those skills might be 
ascertained. The present study investigated this possi- 
bility’ 

Pederson (1970) used low readers solely and found 
no significant picture influences on reading comprehension. 
Might good readers and poor readers both using material 
below their attained grade level be differentially affected 
by included illustrations? Again the present study 


explored this question. 
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Chapter 3 
THE DESIGN OF THE STUDY 


This chapter will describe the population, sample, 
Original version of the testing instrument, revised ver- 
sions of the testing instrument used in this study, data 
collection procedures, and the statistical treatment of 


the data. 
SELECTION OF THE POPULATION 


The population for this study included all stu- 
dents in 13 different classrooms from four elementary 
schools in the Edmonton Public School System. These 
schools had been identified by personnel in the School 
System as available to the investigator for the purposes 
of the study. The investigator was granted permission to 
examine the cumulative record cards of students in these 
classes in order to identify a population of good readers 


and poor readers according to performance on the paragraph 


meaning subtest of the Stanford Achievement Test, Primary 
It Battery. 


Description of the Stanford 
Achievement Test 


This test is designed for use with students from 


grades one to nine inclusive. The test is organized into 
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- five batteries for the various grades and covers several 
subject areas)? Primary “Ib “Battery vis *designed*to be 
administered by the end of grade three and contains sub- 
tests for word meaning, paragraph meaning, spelling, word 
study skills, and language. The test authors sought 
content validity by examining the skills and knowledge 
taught in the various fields, and selecting a representa- 
tive sample of questions to include in the subtests. 
Reliability coefficients for the subtests are high, 
ranging from .83 to .94 (SAT Manual, 1964). 

The paragraph meaning subtest selected for use in 
the present study consists of a series of paragraphs, 
graduated in difficulty, from which one or more words has 
been omitted. Pupils demonstrate their comprehension of 
the paragraphs by selecting the proper word for each 
omission from a choice of four words. Students are 
stopped after 30 minutes and the examiner eecords their 
total correct responses. These raw scores may be normed 
using the grade, percentile, and stanine norming tables 
available with the SAT or they may be left as raw scores 
to be normed for specific school populations. The Edmonton 
Public School System has established local norms for the 


SAT and these were used in the present study. 


Use of the SAT in the present study. The Stanford Achieve- 


ment Test, Primary II Battery, had been administered by 


grade three teachers in the spring of 1974 as part of a 
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system-wide administrative policy. Teachers computed the 
test and subtest raw scores which were normed for yet 
Edmonton Public School System by computer analysis. Since 
these test results were the ones most readily available 

at the time the present study was initiated, they ware 

used for establishing the population of good readers and 
poor readers from’ which the final sample of pupils was 
drawn. Specifically, the profile sheets for all students 
were examined. Sixty-one good readers, those who scored 

at or above the 75th percentile, were identified. Seventy- 
two poor readers, those who scored at or below the 25th per- 


centile, were further identified. 


Selection of Fourth Grade Subjects 


The fourth grade was selected as the most suitable 
testing level for the purposes of this study for several 
reasons. The main reason centred on the reading material 
chosen for the study. Because this study dealt with 
reading comprehension and not word identification, it was 
necessary that subjects reading below grade level be able 
to handle the reading material poise reds. The reading 
material used in this study was calculated to have a 
reading difficulty level of approximately mid-grade two 
(Fry, 1968; Spache, 1974). A further concern was that 
the content of the reading material be interesting even to 
subjects reading above grade level. Another reason con- 


cerned the use of pictures in basal readers. Read (1950), 
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for example, constructed a picture index for basal readers 
and found that there was a gradual and continual decline 
in the use of illustrations in basal readers as grade 
level increased. If the present study showed that pictures 
improved the reading comprehension of good and/or poor 
readers in grade four, educators and publishers might be 
alerted to halt the trend noted by Read. 

It was decided that subjects from the fourth grade 


would meet the above conditions most satisfactorily. 
THE SAMPLE 


With the exception of two good readers and two 
poor readers who were chosen to participate in the pilot 
study, 30 good readers and 30 poor readers were randomly 
selected from the remaining 59 good and 70 poor readers. 
In all instances, randomness was achieved by consulting 
a random number table from Statistical Principles in 
Experimental Design (Winer, 1971). Furthermore, 15 sub- 
jects were randomly selected from each group to read the 
illustrated version of the text and 15 subjects in each 


group read the unillustrated text. 


THE ORIGINAL VERSION OF THE RRCT 


Background 


The Rystrom Reading Comprehension Test (RRCT) is 
based on the text of the children's storybook Caps for 
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Sale by Esphyr Slobodkina. It was devised by Rystrom in 
1969 and consists of 57 multiple-choice questions dealing 
with vocabulary, syntax, item recall, item sequence, inter- 
pretation, and evaluation comprehension. 

Rystrom (1970a) reported that, after many conversa 
tions with reading teachers, he found few who taught from 
a fully formed concrete definition of peace ne comprehension. 
He therefore formulated a reading comprehension skill 
model based on the six areas identified above and designed 
the RRCT in an attempt to apply the model to the measure- 
ment of reading comprehension within the context of a 
particular story. Rystrom hoped that the particular areas 
.suggested might alert teachers to the teaching possibili- 
ties inherent in such a model. 

Figure 1 presents the comprehension model suggested 
by Rystrom (1970a). 

With reference to the model (Figure l), Phe com- 
ponents basic to the RRCT are defined as follows. 

1. Vocabulary requires that the reader know the 
meaning of particular words as they are used in the 
specific context of the passage being read. 

2. Syntax refers to the sentence patterns and 
syntactic items in the story from which the reader may 
gain understanding, using the meaning-overlap between words 
to achieve the meaning of complete sentences. 


3. Item recall requires that the reader remember 
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FIGURE 1 


RYSTROM READING COMPREHENSION MODEL 


Richard Rystrom, "Toward Defining Comprehension: A First 
Report," Journal of Reading Behaviour, -ILl- (2970) ,—S982 (a) 
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specific items in the story which have been selected as 
Significant. | 

4, Item sequence requires that the reader remem- 
ber the sequence in which the above selected items occurred. 

The two remaining comprehension skills are | 
qualitatively more difficult than the previous four skills 
because they require that the reader infer conclusions not 
stated in a reading passage. 

5. Interpretation has the reader make a connection 
between his own experience and the events in a story. 

6. Evaluation has the reader look for internal and 
external consistency in the actions and events occurring 
in a passage and determine the degree to which the passage 
is consistent with itself and/or with the real world. 

There is no linear learning sequence suggested by 
this model. The arrows are meant to indicate that recur- 
siveness is both possible and likely. 

For more information about the model, the reader 


is referred to Rystrom's (1970a) original position paper. 


Description of the RRCT reading material. All test 
questions for the RRCT were based on the story, Caps 

for Sale, told and illustrated by Esphyr Slobodkina (1947). 
This book was illustrated and printed on six inch by 

eight inch paper. The test format for Rystrom's 1969 
investigation consisted of the story (text only) typed on 


three 8 1/2 inch by 11 inch pages, with each paragraph of 
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_the original book remaining in paragraph form in Rystrom's 
version, although Rystrom's typed lines were fewer erdethe 
words per line were more numerous than in the original. 
Slobodkina's book consisted of 21 pages of text, compared 

to Rystrom's three pages. There were 21 six-colour “ate 
trations, drawn by the author, in the original. Rystrom 
eliminated these illustrations for his version. Appendix 
A shows the story format used by Rystrom for the investiga- 


tion conducted in 1969. 


Descriptionso£ the eRRET test questions. Fifty-seven 


multiple-choice questions were developed from the reading 
material. The breakdown of the questions dealing with 
each of the six skill areas proposed by Rystrom's model 


is as follows: 


Vocabulary iy 
Syntax 10 
Item Recall 14 
Item Sequence 19 
Interpretation 4 
Evaluation i 

Total On, 


The test booklet was 10 pages in length and questions and 
answers were typed on 8 1/2 inch by 11 inch paper. Three 
or four possible correct answers were supplied for each 

question and subjects were directed to underline the best 


answer. Appendix B presents the complete text of the RRCT 
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and the answer key. 


Rystrom's Administration Procedures 


The RRCT was first administered by Rystrom in 
October, 1969, to six grade four classes in Georgia. Two 
of the classes were comprised of remedial readers and the 
other four represented a cross section of fourth graders. 
In every instance the test was administered to entire 
classroom groups. Internal consistency reliability was 
measured by correlating performance on the odd and evenly 
numbered items. The reliability coefficients for the six 
classes ranged from .70 to .98 with the average reliability 
being .84. Concurrent validity was measured by correlating 
scoresjon)the RRCT with scores on the California Reading 
Test, which had also been administered in each classroom. 
Correlation coefficients ranged from .84 to .91 with an 
average correlation of .86. 

Based on the above coefficients, the RRCT appears 
to be a reliable and valid instrument of reading compre- 
hension. As such, and because it is based upon an actual 
children's storybook, it was deemed an appropriate instru- 
ment for this investigation. 


THE REVISED VERSIONS OF THE RRCT 
USEDSIN THIS STUDY 


Background 


For this investigation, two versions of the reading 
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.Material for the RRCT were required: an illustrated 
version and an unillustrated version. The iavedt router 
secured an illustrated version of the text, Caps for Sale, 
and produced a second unillustrated version in the same 
format. The following sections describe both veBsioae of 
the test and the present administration of the two revised 


versions of the RRCT. 


Description of the illustrated revised version of the RRCT. 
The paperback edition of Caps for Sale, published by 


Scholastic Book Services in October, 1970, was used as the 
reading material for the illustrated version of the test. 
This book was six inches by eight inches and included 23 
pages of text. 

The original (1947) story listed the colours of the 
Caps aS gray, brown,’ blue, and red. The Vater’ (1970) 
edition listed them as brown, white, gray, and red. This 
alteration was necessary because the paperback edition dis- 
played only five colours instead of the original six. Test 
guestions and answers were not affected by this change. 


There were 23 five-colour illustrations in the 1970 


edition. These illustrations were identical to the original 


edition except for intensity of colour and the colour 


exchange indicated above. 


Description of the unillustrated revised version of the 


RRCT. To maximize treatment effect, the unillustrated 
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, version of the book was designed as similarly to the paper- 
back edition as was possible. The unillustrated version 
was prepared by photo-copying each page of text from the 
paperback edition onto paper of similar weight. Each page 
was then cut to the original size and the pages Svapred 
together into booklet form. A cover of heavier weight 
paper, displaying: the original style of lettering for book 


title and author, was glued to the prepared booklet. 


Description of the test questions. The test questions and 


format devised by Rystrom (see Appendix B) were not 
altered for the present study. Subjects answered the same 
set of questions whatever version of the reading material 
they used. 

In order to test the administration procedures 
first outlined by Rystrom, a pilot study was initiated. 
The results of that study are presented in the next 


section. 
THE ee? SLOLTRS LUDDY 


The pilot study was conducted in April, 1975. 
The investigator sought to retain as much of Rystrom's 
(1970b) procedure as was possible. However, since 
Rystrom's administration involved entire classroom groups 
and this study selected and tested subjects individually, 
there were several points needing clarification. 


Because Rystrom had designed a comprehension 
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. test and not a test of decoding skills, his subjects were 
given assistance with the pronunciation of unknown words 
from the story and/or the test questions. This procedure 
was followed in the present investigation and a record 
aan of the word(s) requested by each subject. Rystrom 
gave his subjects no information regarding word meanings, 
a procedure retained here. Rystrom's subjects were told 
that they could read the story as many times as they wished 
and that they would be asked some questions about it 
afterwards. Subjects in the present study were asked to 
read the story only once and were told that they would be 
asked questions about it. Rystrom's subjects exchanged 
the story for the test questions, another procedure 
followed here. 

As was stated in chapter two, Koenke (1968) had 
noted Goodykoontz' (1936) observation that some subjects 
did not look at the pictures included with ee cen material, 
and so had directed some of his subjects to look at the 
pictures in his study. Since Koenke found no significant 
differences in comprehension among his subjects, whether 
he directed their attention to the pictures or not, no 
specific instructions to view the illustrations were given 
to subjects in the pilot study. However, if it were found 
that subjects in the pilot study who used the illustrated 
book paid no attention to the illustrations, instructions 


to subjects in the picture condition would be altered for 
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the main study. 

Because Caps for Sale might be available in SenOoL 
classrooms and libraries, it was considered necessary to 
ask subjects whether they had previously read the story- 
HOOK PO CEC mate decided to eliminate from the main study 
those subjects who had read the story or were familiar 
with it (by having seen a film, for example), since failure 
to eliminate these subjects would introduce internal 
invalidity to the study through differential subject 
selection. 

Appendix C indicates the procedure followed by the 
investigator during the pilot study. Subjects came to an 
empty room individually. The investigator sat at right 
angles to them in order to observe, closely but unob- 
trusively, their responses to the illustrations. Four 
subjects were tested in the pilot study: two good readers 
and two poor readers, one good reader and one poor reader 
using the illustrated book and the other good and other 
poor reader using the unillustrated version. Total 
administration time for each subject was not less than 
10 minutes and not more than 30 minutes. 

The test directions and procedures were clear and 
well understood, as evidenced by observation of subjects’ 
responses. 

Both subjects who read the illustrated story 


noticed most or all of the pictures even if their attention 
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to them was labelled by the investigator as "glancing at," 
rather than "looking at," the illustrations. 

One subject in the pilot study had read the story 
and one subject knew a story similar to it. The other two 


subjects were not familiar with the story. 


Summary of the Results of the Pilot Study 
On the basis of the pilot study, it was decided to 


transfer all previously outlined procedures to the main 
study, including the presentation of identical directions 
to all subjects and the elimination of subjects familiar 


with the reading material. 
OVERVIEW OF THE MAIN STUDY 


Twenty-four subjects from the original sample of 
60 had to be eliminated from the main study. In one school 
most subjects were eliminated since two of the three class- 
rooms had seen a film of the story earlier in the year. 
Twenty-four more subjects were randomly selected and 
included in the appropriate groups to bring the sample 
back to 60 pupils. Testing was carried on during the last 
week of April and the first two weeks of May, 1975. 
Sixty subjects were tested. 

| Records were kept of subjects' requests for 

unknown words from the story and/or test, and of the time 
taken to read the story and complete the test. Appendix 


D presents this information, arranged according to group 
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and treatment. 

The responses of subjects in the picture Beane 
to the illustrations, are given in Appendix E. The 
investigator observed that none of the subjects ignored 
completely all of the illustrations although some sibseces 


gave them more attention than did others. 
TREATMENT OF THE DATA 


Each subject in the study was given an identifica- 
tion number and labelled according to group and treatment. 
Subjects' total comprehension and subtest comprehension 
scores were computed by the investigator and all of the 
above information was transferred to summary sheets. 

Once these data were prepared, they were punched 
onto IBM computer cards in order to facilitate statistical 


analysis. 
ANALYSIS OF THE DATA 


The Kuder-Richardson procedure for estimating 
reliability (TEST 1, a computer program documented by the 
Division of Educational Research Services, University of 
Alberta, Edmonton) was applied to the data collected in 
this administration of the RRCT. 

The two-way analysis of variance (Computer 
Program ANCV2Z) was the basic statistical test used in 


this study. An F value significant at the .05 level was 
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established as the level at which the corresponding null 
hypothesis could be rejected. | 

The following analysis was made of the data: 

1. The treatment main effect was tested for 
Significance on the group means for total test compre- 
hension and for subtest comprehension. 

2. The significance of the interaction between 
level of reader and treatment given was tested for total 


test comprehension and for subtest comprehension. 
SUMMARY 


This chapter has presented descriptions of the 
population, the sample, the versions of the testing 
instrument, the pilot study, and the data collection 
procedures for the main study. The scoring procedures 
and an outline of the statistical treatment of the data 


concluded the chapter. 
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Chapter 4 
ANALYSIS OF THE DATA 


The nue of this chapter is to present and 
discuss the findings of the study. Since the investiga- 
tion involved the use of an experimental edition of a test 
of reading comprehension, the RRCT, it was considered 
advisable to focus some of the analyses on the test itself. 
Section one of this chapter, therefore, reports upon the 
reliability coefficients obtained in this administration 
Of ieheqRRGE, *hoth fom (a)sethextotal ctest ~indic(b);ithersub- 
tests. Section two reports and discusses the findings as 
they relate specifically to the research questions which 
guided the study. Section three returns to a critique of 
the RRCT by exploring in greater detail selected aspects 
of the syntax subtest of the RRCT. 

RELIABILITY FOR THE PRESENT ADMINISTRATION 
OF THE RRCT 

Rystrom originally measured the reliability of 
the RRCT by correlating performance on the odd and evenly 
numbered items. He reported reliability coefficients for 
each of six separate administrations of the test. He then 
averaged those, and reported a reliability coefficient of 
-82 (Rystrom, 1970b, p- 150). Tuinman and Blanton (1971b) 


questioned Rystrom's decision to take the arithmetic mean 
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of several reliability correlations, which ranged from 
-70 to .98, yet not to report an overall reliability 
estimate. They also questioned Rystrom's failure to 
report reliability coefficients for the six subtests. In 
the light oeeenene criticisms, it was decided in this 
investigation (1) to estimate an overall reliability 
coefficient, and (2) to calculate subtest reliability 
estimates. 

The reliability coefficients reported here are 
based on the application of the Kuder-Richardson procedure 
(Guilford, 1965, pp. 458-460). This method for determining 
reliability ". . . is based on the consistency of subjects' 
responses to all items in the test" (Anastasi, 1968, 

p. 84). Kuder-Richardson Formula 20 takes into account 
all possible ways of subdividing a test and the ". .. re- 
liability coefficient is actually the mean ofall split- 
half coefficients resulting from different splittings of 

a test" (Anastasi, p. 85). 

Table 1 shows the reliability coefficients found 
for this administration of the RRCT. The overall coef- 
ficient of .92 was considered adequate for the purposes of 
this study and added pertinent information to Rystrom's 
(1970b) reported reliability coefficients. Some of the 
difference between Rystrom's overall reliability estimate 
and the present estimate can be explained statistically. 


The odd-even approach used by Rystrom for estimating 
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TABLE 1 


RELIABILITY COEFFICIENTS FOR TOTAL 


RRCT AND SUBTESTS 


Number of 


Test Items 
Total 7, 
Vocabulary f; 
Syntax 10 
Item Recall 14 
Item Sequence jis) 
Interpretation 4 


Evaluation 3 


Coefficient 


2 


- 30 
62 
- 68 
~87 
-03 


- LD 
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reliability is likely to be an underestimate because Sit 
is based on a division of a test in one arbitrary way..." 
(Guilford, 1965, p. 460). This statement is consistent 
with the higher overall coefficient found for the present 
administration. 

Subtest reliabilities, also reported in Table l, 
appear to be consistent with the number of items included 
'in each test, with the smallest subtests, vocabulary, 
interpretation, and evaluation, showing the poorest 
coefficients. Although "tests with reliability coeffi- 
cients as low as .35 have been found useful when utilized 
in batteries withother tests ..." (Guilford, 1965, 

p. 104), it is suggested that the lowest coefficients 
reported here do limit some of the interpretations of the 
findings of the present investigation. As well, these 
coefficients suggest that the subtests of the RRCT need 
to be examined and lengthened, in an effort to make them 
more reliable. Rystrom (1970b, p. 148) did suggest that 
an evident weakness of the RRCT was that the number of 
items in the interpretation and evaluation subtests was 
too small, and the present subtest reliabilities lend 


support to that statement. 
RESULTS OF THE ANALYSIS OF THE RESEARCH QUESTIONS 


The research questions designed in Chapter 1 were 


restated as null hypotheses which were tested for 
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statistical significance by the two way analysis of vari- 
ance procedure. This statistical procedure was applied "6 
the raw scores for total test comprehension and subtest 
comprehension on the RRCT. The results are reported in 
Appendix F. 

The major research questions pertained to the mean 
differences in reading comprehension due to treatment 
main effect and to the interaction between level of reader 
and treatment given. Three F values were calculated by 
each analysis of variance procedure. The F values relating 
to treatment main effect and interaction are reported as 
they relate to each reseatch question. The third F values, 
which relate to the level of reader main effect, are 
discussed informally in all cases, except for the inter- 
pretation subtest. 

Null hypotheses I and II dealt with the research 
guestions concerning treatment main effect, while III and 


IV focussed on the interaction research questions. 


Research Question I 

Will there be significant differences in the total 
reading comprehension scores of good and poor fourth grade 
readers when they read the illustrated or unillustrated 
version of the children's storybook Caps for Sale by 
Esphyr Slobodkina, when comprehension is measured by total 


scores on the Rystrom Reading Comprehension Test? 
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Null Hypothesis I. There will be no significant 
difference between picture and no-picture 
group means for total reading comprehension 


on the Rystrom Reading Comprehension Test. 


Table 2 shows the total comprehension group means 
for good readers and poor readers under the picture and 


no-picture conditions. 


TABLE 2 


GROUP MEANS BASED ON TOTAL 
SCORES ON THE RRCT 


Possible Poor Readers Good Readers 


Score (N = 30) (N =. 30) 
Picture Condition S/ 37.60 502/73 
(N = 30) 
No-Picture Condition 57 SoO0 49.07 
(N = 30) 
Discussion 


As Table 3 reveals, the F value for picture main 
effect for total reading comprehension on the RRCT was 3.35. 
This value did not reach the desired level of significance, 
although it approached significance (.07 level). Null 
Hypothesis I was not rejected. 

The F value for level of reader main effect, shown 
in Table 3, reveals that there were significant differ- 
ences in total comprehension means according to level of 
reader, a finding expected from the original definition 


and selection of good readers and poor readers. 
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Research Question II 
Will there be significant differences in the sub- 
test comprehension scores of good and poor fourth grade 
readers when they read the illustrated or unillustrated 
version of the children's storybook Caps for Sale by 
Esphyr Slobodkina, when comprehension is measured by 
subtest scores on the Rystrom Reading Comprehension Test? 
Null Hypothesis II. There will be no significant 
differences between picture and no-picture 
group means for subtest comprehension on 
the Rystrom Reading Comprehension Test. 
Table 4 shows the subtest comprehension group 
means for the six subtests of the RRCT. 


Table 5 presents the analysis of variance results 


for the six subtests. 


Discussion 

As shown in Table 5, no F values for picture main 
effect were statistically significant except for the 
syntax subtest. The vocabulary and evaluation picture main 
effect F values of 3.20 and 3.32 respectively, approached 
significance (.07 level), but did not satisfy the .05 level 
of statistical significance previously set by the investi- 
gator. Because there was a statistically significant 
difference between picture and no-picture group means on 
the syntax subtest, Null Hypothesis II was partially 
rejected. Figure 2 presents graphically the syntax group 


means given in Table 4 and found significant for picture 
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TABLE 4 


GROUP MEANS BASED ON SUBTEST 
SCORES ON THE RRCT 


Possible Poor Readers Good Readers 


Score (N = 30) (N = 30) 
Vocabulary 
Picture Condition a 2 ee | ee HF f 
(N = 30) 
No-Picture Condition 7 3693 Sta 
(N ="30) 
Syntax 
Picture 10 6.27 9.00 
No-Picture 10 540 8.00 
Item Recall 
Picture 14 126.0 1 DES (sae A 
No-Picture 14 AGT B3267 
Item Sequence 
Picture 19 9.40 L64:27 
No-Picture 19 8.00 16.69 
Interpretation 
Picture 4 Sane S200 
No-Picture 4 Sew e | 3.33 
Evaluation 
Picture 3 1.80 2220 


No-Picture 3 iss 2.00 
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SUMMARY OF THE ANALYSIS OF VARIANCE FOR SUBTEST 


COMPREHENSION ON THE RRCT AS RELATED TO 
PICTURE CONDITION AND LEVEL OF READER 


Source of 


Variance ss df MS F 

Vocabulary 
Pictures (A) 2.02 iL 27.102 3.20 
Reader (B). 36.82 i 36.82 58.35** 
Interaction (AxB) -02 il -02 0.03 
Within Groups SS} S58) 56 -63 

Syntax 

Pictures (A) eS Ol? al aS O07 SaL3* 
Reader (B) 106.67 1 106.67 41.91** 
Interaction (AxB) -07 1 -07 0.03 
Within Groups 42353 56 74 Gis 

Item Recall 
Pictures (A) SG 7/s} at 3.75 1.70 
Reader (B) 36.82 1 36.82 16.73** 
Interaction (AxB) 282 at 2.82 i2s 
Within Groups T2320 56 2.20 

Item Sequence 
Pictures (A) as27 1 4.27 0.35 
Reader (B) 897.07 il 897.07 73.43** 
Interaction (AxB) Ag) i 1b L747) 0.92 
Within Groups 684.14 56 22 

Interpretation 

Pictures (A) ~42 1 42 0.88 
Reader (B) ~82 1 -82 rae 
Interaction (AxB) -42 1 -42 0.88 
Within Groups ZbioS 56 ad 

Evaluation 
Pictures (A) Wor, il 1567 3.32 
Reader (B) Awad i ae27 8.49** 
Interaction (AxB) 247 il B41) 0.53 


Within Groups 28.13 56 .50 


SS ee ee ee ee ee a oot 


*Significant at .05 level. 
**Significant beyond .01 level. 
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FIGURE 2 


GROUP MEANS ON SYNTAX SUBTEST OF RRCT 
(10 items) 
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- main effect. 

All level of reader main effect F values were | 
statistically significant beyond the .01 level except for 
the interpretation subtest. The overall level of reader 
main effect findings indicate that subjects' eEedeeaned 
levels of comprehension were maintained on all present 
comprehension subtests except interpretation. The nature 
of the small number of items included in the interpreta- 
tion subtest may not have allowed for the differentiation 
of reading comprehension levels. This finding is supported 
by the low reliability found for this subtest and reported 


earlier in this chapter. 


Research Question III 

Will the total reading comprehension scores of good 
versus poor fourth grade readers be differentially affected 
when they read the illustrated or unillustrated version of 
the children's storybook Caps for Sale by Esphyr Slobodkina, 


when comprehension is measured by total scores on the 


Rystrom Reading Comprehension Test? 


Null Hypothesis Ill. There will besno interaction 
between level of reader and treatment given for 
total reading comprehension on the Rystrom 
Reading Comprehension Test. 


Discussion 


As was shown in Table 2, the group mean for good 


readers in the picture condition was 50.73 and the group 
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mean for good readers in the no-picture condition was 
49°07, avdifference of 1066:"°Poor readers in’ the picture 
condition had a mean of 37.60 and in the no-picture 
condition a mean of 33.60, a difference of 4.00. As may 
be seen in Table 3, the F value corresponding to the 
interaction source of variance was 0.57, and was not 
significant at the .05 level, indicating that the differ- 
ence between 1.66 and 4.00 was not statistically signifi- 
cant. Consequently, Null Hypothesis III was not rejected 
as the influence of pictures on good readers was not 
Significantly different from the influence of pictures on 
poor readers when total comprehension on the RRCT was 


measured. 


Research Question IV 
Will the subtest comprehension scores of good 
versus poor fourth grade readers be differentially 
affected when they read the illustrated or unillustrated 
version of the children's storybook Caps for Sale by 
ee phys Slobodkina, when comprehension is measured by 
subtest scores on the Rystrom Reading Comprehension Test? 
Null Hypothesis IV. There will be no interaction 
—pbetween level of reader and treatment given 


for subtest comprehension on the Rystrom 
Reading Comprehension Test. 


Discussion 


Table 4 includes the means pertaining to all 
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subtests referred to in Null Hypothesis IV. As Table 5 
shows, no F values for interaction were significant at 
the .05 level. Therefore Null Hypothesis IV was not 
rejected. Good readers and poor readers were influenced 
in a similar manner when pictures were included with the 
text of Caps for Sale and when subtest comprehension on 


the RRCT was measured. 


Summary 


The research questions examined in this study con- 
cerning possible significant differences in the reading 
comprehension of subjects reading illustrated or unillus- 
trated textual material were not, for the most part, upheld 
statistically. Of the 14 sets of performance means 
analyzed in this chapter, 12 sets showed means favouring 
the picture condition. However, statistical analysis 
revealed that for only two of those 12 pairs of means, 
the syntax means, was there a significant difference 
between the picture and no-picture groups. That the 
influence of illustrations approached statistical signifi- 
cance for total comprehension and vocabulary and evaluation 
comprehension warrants further investigation of these 
particular areas. 

The research questions concerning possible differ- 
ential effects of illustrations on the reading compre- 
hension of good versus poor readers were not upheld by the 


statistical results. Good readers and poor readers were 
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not differentially affected, in a statistically signifi- 
cant manner, on any of the aspects of conpranenetonutested 
here. This finding suggests that whatever the influence 
of pictures on reading comprehension, this influence 
appears to be similar whether readers are classified as 


good comprehenders or poor comprehenders. 
CRITIQUE, OF THE RRCT SYNTAX SUBTEST 


The only statistically significant picture main 
effect in this study was found on the syntax subtest of 
the RRCT. <In an attempe,.to, explain the statistical 
findings concerning this subtest, the syntax questions 
(see Figure 3) were examined in detail. 

The analysis of this subtest revealed that it 
measured several skills in addition to the understanding 
of syntactic structures. Question 2.10 was the only "pure" 
syntax question in that it required the subject to match 
the meaning of one sentence to its paraphrased counterpart. 
Two questions (2.1, 2.2) included syntactic change plus 
recall and two others (2.4, 2.6) involved memory for 
detail, as well as syntactic and semantic change. 

Questions 2.5, 2.7, and 2.8 required memory for sequence 
plus understanding of syntactic and semantic changes. 

Item 2.9 involved inference and no syntactic change. The 
remaining syntax question (2.3) will be discussed in the 


following paragraphs. This analysis shows that the syntax 
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The peddler in the story was 


a. an 
be = no 
5. ap 


ordinary peddler 
t an ordinary peddler 
st another peddler 


d. a door to door salesman 


An ord 
a. on 
Deen 
Che On 
Qe, On 


inary peddler carries his wares 


his head 
his car 

his horse 
his back 


he held himself straight means 


awe ne 
b. he 


held the caps straight 
stood straight 


c. his caps were straight 


d. he 


walked in a straight line 


The peddler held himself straight because 


Ele — Ine 
bee hz 
Comehe 
d. he 


The peddler sat down under a tree. 


s back hurt 

s mother told him to 

was refreshed and rested 
didn't want to drop any caps 


Next he 


a. leaned back 

b. went to sleep 
c. saw the monkeys 
d. became angry 


The peddler leaned back against the tree carefully 


because 


a. he 
Deane 
c. he 
d. he 


didn't want to hurt his head 
didn't want to knock off his caps 
was tired 

saw the monkeys in the tree 


After the peddler sat down he 


a. fe 
ba.weesa 
Coys 


11 asleep immediately 
id "Hello" to the monkeys 
t his pipe 


d. made sure his caps were straight 


When he woke up the peddler 


ae re 


ached for his caps 


b. reached for his checked cap 


Cc. re 


ached for the monkeys 


d. opened his eyes and went back to sleep 


The peddler said "You monkeys, you" because 


a. he 
b. he 
c. he 
dn ene 


didn't remember their names 
was angry 

was sleepy 

was hungry 


Give me back my caps is the same as 


a. give me those caps 


be. pu 


t the caps on my back 


c. give back my caps to me 
d. give my back a tap 


FIGURE 3 


SYNTAX QUESTIONS FROM THE RRCT 
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results were confounded by the types of questions included 
within this subtest. However, the reliability of the | 
syntax subtest (see Table 1) indicated that subjects 
responded as consistently here as they had onother sub- 
tests of similar length. Table 6 indicates the Overan 
superiority of the picture groups over the no-picture 
groups but shows no discernible response tendencies con- 
cerning the types of questions asked. 

The foregoing analysis of this subtest shows that 
it should not be considered a valid test of syntactic 
comprehension. Although subjects' responses on this 
subtest were fairly consistent (see Table 1), it is 
difficult to ascertain just what type of skill was being 
measured. Several of the existing questions might be 
relabelled and included within other subtests on the RRCT. 
For instance, questions 2.5, 2.7, and 2.8 might be added 
to the item sequence subtest. Several other Oireracicns 
might be made to the present questions but basically this 
subtest needs to be examined and the questions redesigned. 

In a further attempt to account for the syntax 
subtest statistical findings, the investigator utilized 
the data in Appendix G. This appendix shows the sources 
of information considered available to subjects answering 
the RRCT questions. During May, 1975, the investigator 
submitted the illustrated book and the comprehension test 


to four graduate students. They read the book, answered 
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- each question on the comprehension test, and were then 
given a chart listing the various information ae ae 
considered available to subjects taking the test. These 
sources of information were considered to be: text 

alone, picture or pictures alone, text and picture(s) 
combined, and general knowledge possessed by the reader. 
The raters were instructed to check the primary source 

of information used by them to answer each question as 
well as to indicate any secondary sources they considered 
important. Concerning the sources of information presumed 
available for syntax comprehension on the RRCT, there was 
rater agreement on nine of the ten syntax guestions. On 
only one (2.8) of these nine questions did all raters 
choose pictures as a possible source of information. For 
this question pictures were considered to be a source of 
information along with the text. No raters chose pictures 


as information sources for the remaining eight questions. 


Concerning the question (2.3) over which rater disagreement 


occurred, one rater included pictures along with general 
knowledge as the sources of information considered impor- 
tant. Another rater chose general knowledge alone and the 
other two chose general knowledge in conjunction with the 
text of the book. Question 2.3 contains the idiomatic 
expression "he held himself straight," an English usage 
difficult to analyze in terms of possible avenues of 


information leading to meaning. Pictures appeared to make 
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the meaning of this syntactic construction clearer to the 
subjects in this study. 

As evidenced by rater choices, there was no clear 
indication as to why pictures significantly affected 
performance on the syntax subtest. Pictures may have 
collectively added to subjects' understanding of the 
meanings of the syntactic structures tested on this sub- 
test. They could have alerted subjects to certain 
meaningful details included within the text and portrayed 
in the pictures. Or pictures may have given enough 
emphasis to certain events that these could be recalled 
more readily by subjects answering the syntax questions. 


This finding merits continued investigation. 
SUMMARY 


This chapter presented total test and subtest 
reliabilities for the present administration of the RRCT. 
It also dealt with the analysis and interpretation of the 
findings of this study. Four research questions were 
asked and the corresponding null hypotheses tested for 
statistical significance. Although there were superior 
picture group means on six of the seven comprehension 
measures tested here and the F values for three of these 
six measures did approach statistical significance, only 
syntax comprehension was significantly higher for subjects 


in the picture groups. Present findings suggested that 
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illustrations do not differ statistically in their 
influence upon the reading comprehension of good readers 
and poor readers reading the same illustrated textual 


material. 
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Chapter 5 
SUMMARY AND CONCLUSIONS 


The purpose of this study was to investigate the 
differences, if any, in children's reading comprehension 
of textual material when illustrations were included with 
that material and when they were not. Another concern was 
to determine if illustrations differentially influenced the 
reading comprehension of good readers and poor readers 
reading the same textual material. By reading compre- 
hension was meant total scores and subtest scores on the 
Rystrom Reading Comprehension Test (RRCT). 

In order to accomplish these objectives, two treat- 
ments were administered. One-half of the subjects read 
am uitustrated ‘story and thénm completed =the RRCT. ° The 
other subjects read an unillustrated version of the same 
story and completed the RRCT. Subjects were divided into 
good readers and poor readers on the basis of prior reading 
comprehension performance and were assigned to one of the 


treatments. 
SAMPLE 


Subjects were chosen from 13 grade four classrooms 
in the Edmonton Public School System. They were selected 


according to percentile rank on the paragraph meaning 
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subtest of the Stanford Achievement Test, as this was the 
most readily available measure of reading comprehension. 
Good readers were children ranking at or above the 75th 
percentile on the 1974 Edmonton norms for the above subtest 
while poor mendes were those who ranked at or below the 
25th percentile. Thirty good readers and 30 poor readers 
were randomly selected, from 59 good and 70 poor readers, 
to participate in this investigation and 15 subjects from 
each group were randomly chosen to be in the picture 
condition. The remaining subjects received the no-picture 
treatment. Grade four was chosen, in part, because Read 
(1950) had revealed that the use of pictures in elementary 
reading textbooks gradually diminished as grade level 
increased. The present study might redirect that trend if 
it were shown that the reading comprehension of children 
in grade four was higher when illustrations were included 


with textual material. 


THE TESTING INSTRUMENT 


Reading Material 

The 1970 paperback edition of the children's story- 
book Caps for Sale by Esphyr Slobodkina was used as the 
reading material for the picture condition of this study. 
The no-picture version was prepared by photocopying the 
textual pages of the paperback edition and stapling them 


into booklet form. This booklet was identical to the 
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paperback in format and size except for the exclusion of 
the illustrations. 

Caps for Sale was used for several reasons. First, 
it was an existing children's storybook, told and illus- 
trated by ene author, and not designed for the present 
study. The illustrations were an integral part of the 
book's format and their use here prevented whatever bias 
might have resulted from experimenter selection and/or 
design. Second, because this study was concerned with 
reading comprehension, it was important that the reading 
material selected be simple enough so that word recognition 
would not unnecessarily limit Subyects? reading compre- 
hension. "Caps" for Sale appeared toysatisfy this condition 
as the reading difficulty level calculated for this text 
was approximately mid-grade two. Another reason for 
choosing Caps for Sale was that the comprehension instru- 
ment used here, the Rystrom Reading Comprehension Test, 


was developed expressly to measure the reading compre- 


hension of this story. 


Test Questions 


The comprehension instrument used in this study was 
the experimental edition of the Rystrom Reading Compre- 
hension Test devised by Richard Rystrom in 1969. It was 
designed to suggest and test a teaching model of compre- 
hension and was composed of six defined aspects of reading 


comprehension. The RRCT contains 57 multiple-choice 
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comprehension questions: 7 deal with vocabulary, 10 with 
syntax, 14 with item recall, 19 with item sequence, 4 with 
interpretation, and 3 with evaluation. In 1970, Rystrom 
reported an odd-even reliability estimate of .84 anda 


COMCULIENT ValigdityioreosG toresthis test. 
TREATMENT PROCEDURES 


An attempt was made to follow as many of Rystrom's 
1969 procedures as was possible. Subjects were given 
assistance with the pronunciation of any unknown words 
from either the book or the comprehension test. They had 
unlimited time to read the book and answer the questions. 
Whereas Rystrom's subjects read only a specially prepared 
version of the book minus illustrations, subjects in this 
study read either of the two story formats previously out- 
lined. Subjects were tested individually in empty rooms 
within the four schools involved. 

A pilot study was conducted in April, 1975, to 
ascertain the acceptability of the treatment procedures. 
Subjects in the picture condition seemed to attend to the 
pictures even though they were not specifically directed 
to do so. For this reason, and because of Koenke's (1968) 
findings of non-significance concerning the extent and 
type of directions given to subjects, it was decided to 
give a single set of directions to all subjects. Since 


all subjects in the pilot study followed the directions 
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adequately, all pilot study procedures were carried over 
to the main study. 

The main study was carried out during April and 
May, 1975. All subjects completed the RRCT after reading 
the appropriate version of the story. If a subject had 
previously read or was familiar with the story, he or she 
was eliminated and another subject randomly chosen for 


the appropriate group. 
FINDINGS 


Two statistical procedures were used to analyze 
the data in this study. The Kuder-Richardson procedure 
for estimating reliability estimated the overall test 
reliability and subtest reliabilities for this administra- 
tion. The two way analysis of variance procedure dealt 
with the research questions designed in Chapter 1, which 
were restated as null hypotheses and tested for statis- 


tical significance. 


Research Question I 


Will there be significant differences in the total 
reading comprehension scores of good and poor fourth grade 


readers when they read the illustrated or unillustrated 


version of the children's storybook Caps for Sale by Esphyr 


Slobodkina, when comprehension is measured by total scores 


on the Rystrom Reading Comprehension Test? 
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Research Question II 

Will there be significant differences in the sub- 
test comprehension scores of good and poor fourth grade 
readers when they read the illustrated or unillustrated 
version of the children's storybook Caps for Sale by 
Esphyr Slobodkina, when comprehension is measured by sub- 


test scores on the Rystrom Reading Comprehension Test? 


Research Question III 

Will the total reading comprehension scores of 
good versus poor fourth grade readers be differentially 
affected when they read the illustrated or unillustrated 
version of the children's storybook Caps for Sale by 
Esphyr Slobodkina, when comprehension is measured by total 


scores on the Rystrom Reading Comprehension Test? 


Research Question IV 

Will the subtest comprehension scores of good 
versus poor fourth grade readers be differentially affected 
when they read the illustrated or unillustrated version of 
the children's storybook Caps for Sale by Esphyr Slobodkina, 
when comprehension is measured by subtest scores on the - 


Rystrom Reading Comprehension Test? 


The findings from the study were as follows: 
1. The overall test reliability was estimated as 
.92. Subtest reliabilities ranged from .87 to .03 and 


were consistent with the number of items in each subtest, 
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the smallest subtests showing the poorest coefficients. 

2. There were no statistically significant differ- 
ences in subjects' total comprehension of reading material 
when pictures were included with that material. Nor were 
there significant differences in comprehension on the 
vocabulary, item recall, item sequence, interpretation, 
and evaluation subtests when pictures were present. The 
difference between performance means did approach statis- 
tical significance for total comprehension and for 
vocabulary and evaluation comprehension. 

3. Pictures did make a statistically significant 
difference in the comprehension of the syntax subtest. 

The means of the picture groups were significantly higher 
than the means of the no-picture groups on this subtest. 

4. Good readers and poor readers were similarly 
affected by pictures whether total comprehension or sub- 


test comprehension, on the RRCT, was measured. 
LIMITATIONS 


With any research study, there are certain inherent 
limitations arising from its experimental nature. So that 
conclusions from this study will appear in proper perspec- 
tive, certain limitations beyond those given in Chapter l 


need to be noted. 


1. Although a high overall reliability coefficient 


was found for this administration of the RRCT, one. 
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consistent with that reported by Rystrom, several subtest 
reliabilities, notably interpretation and evaluation, were 
less than desirable. This should be considered when the 
results of the investigation are discussed. 

2. Another cautionary dimension concerns the 
validity of the items within each subtest. Does each 
item, in fact, measure what it purports to measure? 
Detailed analysis of the syntax subtest revealed several 


components in addition to the measurement of syntax. 


Although Rystrom did report a high correlation with another 


reading achievement test, this coefficient was based on 
global comprehension skills and not on subtest performance. 
The experimental edition of the RRCT,will; require further 
validation and refinement concerning subtest measurement. 
3. Because of the multiple-choice nature of the 
test questions, answers were limited in scope. This may 
have parereulardy affected the interpretation se evalua- 
tion subtests where the intent of the questions was that 
the subject look for answers beyond the information given. 
By forcing the subject to choose among given alternatives, 
this format may have inhibited or altered his responses. 
4. It was impossible to tell how each subject 
in the picture condition used the pictures. Was the sub- 
ject looking for information additional to the text? Did 
the subject expect to learn anything from the pictures? 


Because a subject's background use of pictures in reading 
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material could not be known, it was not clear how he per- 
ceived the experimental situation. } 
Considering these limitations, plus the factors 
outlined in Chapter 1, it would be wise to exercise caution 
when generalizing from this study. Only when ee 
testing conditions and instruments are used could one 
reasonably expect to achieve similar results. Generaliza- 
tions applicable to the elementary classroom need to be 
cautiously formulated until further investigations and 


improvements are made. 
CONCLUSIONS AND DISCUSSION 


The results of this study tended to corroborate 
the findings of Miller (1938), Vernon (1953, 1954), 
Koenke (1968), and Pederson (1970), that pictures included 
with textual material do not significantly enhance a sub- 
ject's comprehension of that material. Present eee 
more fully confirmed Pederson's findings that most aspects 
of literal and inferential comprehension, when measured by 
a multiple-choice test, were not influenced significantly 
by the presence of pictures in reading material. This 
study did however offer an additional finding. Compre- 
hension on the syntax subtest of the RRCT was signifi- 
cantly affected when pictures accompanied textual material. 
This finding suggests the need for further investigation 


into the nature of this influence. 
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Although the reading comprehension of good readers 
(Weintraub, 1960) and poor readers (Pederson, 1970) had 
been investigated separately, not until Bluth (1972) was 
the comparative comprehension of good readers and poor 
readers, reading the same textual material, sacce tated: 
No interaction between reader level and picture condition 
was found in the present study whereas Bluth found that 
good readers comprehended significantly better when 
pictures were present. Because Bluth used the cloze 
technique for measuring comprehension it may be that this 
measure differs enough from the multiple-choice format 
used here that direct comparison cannot be made. This 
suggests an area worthy of investigation. Another reason 
for the discrepant findings may be found in the differing 
definitions of good readers and poor readers. Bluth chose 
readers from the top three and bottom three stanines on 
the California Achievement Test. The present subjects 
covered a wider range of ability in both categories. Low 
readers in Bluth's study may have been so hampered by word 
recognition difficulties and/or failure to understand the 
task that they may have been unnecessarily penalized. 


The present study indicated that if poor readers were 


given assistance with the pronunciation of words, understood 


the given task, and answered a multiple-choice test, they 


were influenced by pictures no differently than were good 


readers. 
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One of the concerns of this study was that the 
trend toward the continual decline in the use of ace 
trations in basal readers as grade level increases might 
hinder the reading comprehension of upper elementary 
students. This study has not borne out the desimpdidn 
made by the investigator that pictures might benefit the 
reading comprehension of some children in grade four. How- 
ever, because picture influence approached significance in 
several areas, most notably with total reading compre- 
hension, the suggestion that pictures may play a pedagogi- 
cal role in children's comprehension of reading material 
is made. Considering this influence, it would be premature 
to advocate the removal of illustrations from children's 
reading materials. 

This study indicated that both good readers and 
poor readers in grade four were affected by adjunctive 
illustrations similarly enough that educators need not 
necessarily treat children differently regarding that 
type of illustration. It could be argued, though, that 
because the illustrations used in this study acted as 
adjuncts to the text, they offered so little added informa- 
tion to the text that possible reader differences could 
not arise. Most previous research studies in this area, 
save for Goodykoontz' (1936), have dealt with pictures 
used as adjuncts. Another profitable area for further 


investigation would be the examination of the effects 
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which non-adjunctive illustrations might have on children's 
reading comprehension. 

Building on Koenke's (1968) report that direction 
to view the included pictures presented no statistically 
Significant advantage to the reader, the present administra- 
tion employed no such direction. Present subjects did 
notice the pictures even if they glanced very quickly at 
them while focussing their main attention on the text. 

If the accompanying illustrations had not been used as 
adjuncts, subjects' comprehension might have been more 
influenced by direction to view the illustrations, as was 
suggested by the Goodykoontz' (1936) experiment. 

This study did not focus on picture style or format 
but used the illustrations as they were found in the 
reading material. Bloomer (1960) made some suggestions 
regarding children's preferences in pictures but did not 
look at Arcee preference and reading comprehension per 
se. This type of interaction merits further investigation. 

In conclusion, then, this investigation did not 
offer strong statistical:support stonntie spositive influence 
of pictures on children's reading comprehension. It did 
suggest an effect approaching significance for total 
measured comprehension, vocabulary comprehension, and 
evaluation comprehension. Syntax comprehension was 
significantly higher when pictures were included with the 


reading material. As to the expense incurred by publishers 
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of children's reading materials, who generally include 
illustrations with the texts, this study does not provide 
firm direction regarding that practice. It suggests 

that pictures can influence reading comprehension and 
points to a significant influence in one comprehension 
area. Rather than providing conclusive evidence regarding 
the issue, this study pinpoints further areas needing 
exploration and adds new knowledge to the topic of the 
influences of illustrations on children's reading compre- 


hension. 
RECOMMENDATIONS FOR FURTHER RESEARCH 


Research studies tend to raise more questions 
than they answer and this study was no exception. The 
following suggestions are made regarding further areas 
for investigation: 

1.o' léhthe RRC is to be used again experimentally, 
it is suggested that the smaller subtests be examined and 
enlarged in an effort to improve the reliabilities of these 
measures. As well, a complete item analysis should be 
carried out, to be followed by a cross validation with a 
new sample in an effort to develop item validity. 

2. Because this study found that syntactic compre- 
hension, as measured by the RRCT, was significantly 
influenced by pictures, further detailed analysis of this 


influence needs to be explored. The present syntax 
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subtest should be refined and expanded so that syntactic 
skills are separated from certain memory and sonanticy) 
components, or a more appropriate test of syntax might be 
designed. 

3. The present study could be replicated at 
another grade level, possibly grade two. This might give 
evidence that poor readers reading material beyond their 
attained grade level were substantially influenced or 
assisted by pictures in certain areas of reading compre- 
hension. 

4. This study could be replicated at the grade 
four level with the addition of a cloze measure of compre- 
hension, presented with and without the present illustra- 
tions. The comparison of comprehension measures might 
yield significant information regarding the nature of the 
two instruments and might add further knowledge to the 
findings of Bluth CL97273 

5. Another study might use non-adjunctive illus- 
trations and test the present areas of reading compre- 
hension. Test sections would include questions which 
could be answered from the text or the included illustra- 
tions. One group could be directed to viewsthe pictures 
and another group not so instructed. This could give 
direction to the producers of children's reading materials 


concerning the various functions and influences which 


illustrations can have. 
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6. A teaching experiment could be conducted in 
which children were taught to "read" different types of 
pictures. A test measuring the six aspects of comprehen- 
sion dealt with here could be constructed. If pictures 
could be designed to focus on these six areas, a Bhat een 
could be made of the reading comprehension of children 
taught to use pictures for informational purposes and 
those not taught such skills. 

7. Various picture formats and styles could be 
developed and their influences on specific aspects of 
comprehension could be investigated. This might give 
insight to the illustrators and publishers of children's 
reading materials. 

8. This study did not deal with the motivational 
effects of pictures on children. Is children's reading 
comprehension enhanced because of a motivational aspect 
which illustrations provide? Further work could be under- 


taken in this area. 
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APPENDIX A 


RYSTROM'S STORY FORMAT 
OCTOBER 1969 
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EsphyrSlobodkina. Caps for Sale. New York: William R. Scott, 


Inca 1947. 

Once there was a peddler who sold caps. But he was not like an 
ordinary peddler carrying his wares on his back. He carried them on 
top of his head. 

First he had on his own checked cap, then a bunch of gray caps, 
then a bunch of brown caps, then a bunch of blue caps, and on the 
very top a bunch of red caps. 

He walked up and down the streets, holding himself very straight 
so as not to upset his caps. 

As he went along he called, "Caps! Caps for sale! Fifty cents 
a cap". 

One morning he couldn't sell any caps. He walked up the street 
and he walked down the street calling, "Caps! Caps for sale. Fifty 
cents a cap." 

But nobody wanted any caps that morning. Nobody wanted even a 
red cap. 

He began to feel very hungry, but he had no money for lunch. 

"IT think I'll go for a walk in the country," said he. And he 
walked out of town - - slowly, slowly, so as not to upset his caps. 

He walked for a long time until he came to ageat big tree. 

"That's a nice place for a rest," thought he. 

And he sat down very slowly, under the tree and leaned back 
little by little against the tree-trunk so as not to disturb the 
caps on his head. 

Then he put up his hand to feel if they were straight - - first 
his own checked cap, then the gray caps, then the brown caps, then 


the blue caps, then the red caps on the very top. 


1s 


| ¢2qeo. Gury To saiated & “andy. ve “pailosily- ner Paras: 


tép terde vrav Pi paai oeibfod . nieuade: oft wal 06 | qu | 


) 6 i rm Art mom  VvPOor Set ero JGHd 298) YS bebnow aden 


34022 Oe ee -2f62 90753 alt 

| ; : i , ee See 7 

nc Stl Jom aaw on sue - &G89 bho ottw 1s 
ne matt botwéa oH Ad etn no 2076" ta 


i) : te 


i AO bre 1983 ould te donb: 8 asia. 2909 mora to 
penyngcytt: 


289. ans $2qu, ob P08 
efaoo yOhED falas wet eged eg” von gat mk a WE = 


| 4 
a 
7 Kal rr 


toate Sty qu ORE Rw .2an vie vie seatalwoo sit yintyinen: 7 
wiktY Jolie 2G UeRee cate  thotte wl oy oto 


ino 83 eS 


font wet eanodk on ben of 908 sand eine fest ‘ot aspod otf 
oy! bah od bree “vices ad at Ale a. nOY 0 1t' thy? 4 
62469 etd 2ozqy OF Don 26 Oa, YlOFe fieoa ~ ~ wal to duo’ had few. 
ae etd dees ot ways ef fithu goty gaol 6. vot bedfew oh 
Oa dipondd " deey 6 ICT anata sain 6 2) fed” 


tagd bensel bag eed aut A seikat » efweld array coh t52 of bal 


“odd dwsdtath oo 260 da 02 vid ‘ott say hogs -ottaht Ww ofsttt oa 
sheer efi mo 2qe2 sal 
Seitt - - Mippente siewiyads ” tat cdubnsea sth i 2a of nodT : , 
nat? . gio dwoid od). odd, aah NENG: 48 gods 40 besos mo 2nd 4 


eo * 


' 


\ Gnd vey si} ‘na. 2480 bo afd ‘oartd) 42qu9 ould ois 
7 ee — rt a | 


Ta 4 _ a ee 


They were all there. 

So he went to sleep. 

He slept for a long time. 

When he woke up he was refreshed and rested. 

But before standing up he @1t with his hand to make sure his 
caps were in the right place. 

All he felt ons own checked cap! 

He looked to the right of him. No caps. 

He looked to the left of him. No caps. 

He looked in back of him. No caps. 

He looked behind the tree. No caps. 

Then he looked up into the tree. 

And what do you think he saw? 

On every branch sat a monkey. On every monkey was a gray, or a 
brown, or a blue, or a red cap! 

The peddler looked at the monkeys. 

The monkeys looked at the peddler. 

He didn't know what to do. 

Finally he spoke to them. 

"You monkeys, you," he said, shaking a finger at them, "you give 


me back my caps." 


But the monkeys only shook their fingers back at him and said, 


Ris zemtSz7 US 26. 


This made the peddler angry, so he shook both hands at them and 


said, "You monkeys, you! You give me back my caps." 


But the monkeys only shook both their hands back at him and said, 


Wise ots7.. tSze 


88. 


\ 
ovip uoy” ,worte ve separ? er chisy a Le as ‘oie 


i . m ft 
| a, " 4 Mg ” ; : 
cane aaa ® 
edt the Saray yaa 
2 me teas iy 
qsehe 039 new od ee. 
hr wt Lae 54 Vor: in ote aH) 
hey a} i . nye 
bates, bas bedacitoy esw ait, qu's? tow or] aod 


i] My : ~ 
iY aN 218 pt qu paihiate s1oted 3 8. 


’ 
on 


sos dele Py sit ace 2053 
7 gi az". 


fh} Osada 9a iw my 26w $h t 3a. iM, 


a0n5 Of «mT TO Te add 6 hevoo! § 
7 ¥ up 7: a 
aqno GN. .whdt to Del silt oF bagi, at 
‘ . ~ ~ 
5 aff to azed ak bedoo! sit 
~ . | 7 
yo send a ith etd Sie 
met | i : y Hin? au be! tot. ae i fall 
¥ ig2\ 3 poate we ob on baw, 
oa f , WO i nb ia nat edt 
hile ¥4 | vuctay yraye an iv cain a ; ka: foneid vi ws ba, : i‘ 
f : ‘ 1 a < 
: ory i 6. cant 10 66 : 
7 , a Sar Wd aie es wrehatd i ne 
ee ere aid is be aco! ag Thien ett 
a) ) rr ie 
retbbeg, ats de'5 f ee ae drop oo 
: % / va 09 ftw 5 rons $" nth of os 
nek | matt ot atoqe, 4 rice 


xa yo eh 


iss 7 ie 
att 


| Du i Lee, sles 
aid t6 dome sughh > ciedts Aone ype za am 
f vis) f i = 
| eee L iy ed) i ro 
+l aw ey Z my 7 7 


7 apie ae: an 3 


abrsi itd topite wig 
ein 


b eee 


yaitne 


» 


Now he felt quite angry. He stamped his foot, and he said, 
"You monkeys you! You better give me back my caps!" 

But the monkeys only stamped their feet back at him and said, 
SZ 5 0USZ s,s Zan, 

By this time the peddler was really very, very angry. He stamped 
both his feet and shouted, "You monkeys, you! You must give me back 
my caps!" 

But the monkeys only stamped both their feet back at him, and 
Said. (SZ, tS2, tsz.- 

At last he became so angry that he pulled off his own cap, threw 
it on the ground, and began to walk away. 

But then, each monkey pulled off his cap... 

and all the gray caps, 

and all the brown caps, 

and all the blue caps, 

and all the red caps came flying down out of the tree. 

So the peddler picked up his caps and put them back on his 
head - - 

first his own checked cap, 

then the gray caps; 

then the brown caps, 

then the blue caps, 

then the red caps on the very top. 

And slowly, slowly, he walked back to town calling, "Caps! 


Caps for sale! Fifty cents a cap." 
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APPENDIX B 


RYSTROM READING COMPREHENSION TEST 
AND ANSWER KEY 
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RYSTROM READING COMPREHENSION TEST 


(Experimental Edition) 


September, 1969 


The University of Georgia 
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Underline the best answer. 
el A peddler is 
a. a toy for children 
b. aman who sells things 
c. a kind of ctothing 
d. aman who builds houses 
hee An ordinary peddler is 
a. like everyone else 
b. not like other peddlers 
c. like other peddlers 
d. riding a bicycle 
as The Wares are the 
a. caps 
b. food 
c. animals 
d. children 
1.4 A checked cap is 
a. all one color 
b. different colors in squares 
c. different colors in rows 
d. different colors in circles 
eo A bunch of caps is 
a. a headache 
b. many caps 
Cc. . one cap 


d. two caps 
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The peddler was refreshed. He was 
a. rested again 

b. tired 

c. just the same 

d.. ( thirsty. 

In the story upset means to 

a. make angry 

b. tear 

c. get dirty 

d. scatter around 

The peddler in the story was 
a. an ordinary peddler 

b. not an ordinary peddler 

c. just another peddler 

d. a door to door salesman 

An ordinary peddler carries his wares 
a. on his head 

Db. « inshisacar 

c. on his horse 

d. on his back 

he held himself straight means 
a. he held the caps straight 
Be he stood straight 

c. his caps were straight 


d. he walked in a straight line 
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The peddler held himself straight because 
a. his back hurt 

b. his mother told him to 

c. he was refreshed and rested 

d. he didn't want to drop any caps 

The peddler sat down under a tree. Next he 
a. leaned back 

b. went to sleep 

c. saw the monkeys 

d. became angry 

The peddler leaned back against the tree carefully because 
a. he didn't want to hurt his head 

b. he didn't want to knock off his caps 
c. he was tired 

d. he saw the monkeys in the tree 

After the peddler sat down he 

a. fell asleep immediately 

b. said "Hello" to the monkeys 

c. lit his pipe 

d. made sure his caps were straight 
When he woke up the peddler 

a. reached for his caps 

b. reached for his checked cap 

c. reached for the monkeys 


d. opened his eyes and went back to sleep 
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The peddler said "You monkeys, your because 
a. he didn't_remember their names 

b. he was angry 

c. he was sleepy 

d. he was hungry 

Give me back my caps is the same as 

a. give me those caps 

b. put the caps on my back 

Cc. give back my caps to me 

d. give my back a tap 

What did the peddler sell? 

a. pots and pans 

b. caps 

c. toys 

Where did the peddler carry his wares? 

a. in a wagon 

b. on his back 

c. on his head 

Did the peddler have a cap of his own? 

a. Yes, a cap just like the ones he sold. 
b. No, he did not have a cap of his own. 
c. Yes, a cap not like the ones he sold. 
The peddler sold caps that were 

a. different colors 

b. different shapes 


c. all one color 
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How did the peddler carry his caps? 

a. stacked on his arm in a special order 
b. stacked on his head in a special order 
c. stacked on his Head in-no-special order 


How much did each cap cost? 


a. $1.00 
b. 50¢ 
(op 10¢ 


Why did the peddler walk in the country? 
a. because he could not sell any caps 
b. because he sold all his caps 

c. because he wanted to see the monkeys 
What did the peddler do in the country? 
a. he played a game with some children 
b. he went to sleep under a tree 

c. he ate his lunch under a tree 

What happened to the peddler's caps? 

a. some monkeys took them 

b. some children took them 

c. the wind blew them away 


“hen the peddler saw his caps were gone he 


‘a. went back to sleep 


b. walked back to town without his caps 


c. tried to get his caps back 
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What did the monkeys do? 

a. they copied everything the peddler did 
b. they ran away from him 

c. they just looked at him 


How did the peddler feel when he couldn't get his caps back? 


a. happy 
b. sad 
c. angry 


What did the peddler do just before he got his caps back? 
a. he climbed up the tree to get his caps back 

b. he threw his own cap on the ground 

c. he sat down and cried 

What did the peddler do after he got the caps back? 

a. he chased the monkeys 

b. he threw the caps at the monkeys 


c. he put the caps on his head and walked back to town 
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Fill in the blanks. 


Group A Sentences 


These sentences from the story are mixed up. Write a 1 on the line 
next to the sentence that should be first; write a 2 on the line next 
to the sentence that should be second; write a 3 on the line next to 
the sentence that should be third. 

1. The peddier went to sleep for a long time. 

2. He felt the caps on his head to see if they were straight. 


3. He sat down under the tree to rest. 


Group B Sentences 


These sentences from the story are mixed up. Write a ee the line 
next to the sentence that should be first; write a 2 on the line 
next to the sentence that should be second; write a 3 on the line 
next to the sentence that should be third. 
4. The peddler walked up and down the streets of the town one 
morning trying to sell his caps. 
5. No one bought any caps so he went for a walk in the country. 


6. He arranges the caps he sells in a special order on his head. 
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Fill in the blanks. 


Group C Sentences 
These sentences from the story are mixed up. Write a_l on the line 
next to the sentence that should be first; write a 2 on the line 
next to the sentence that should be second; write a3 on the line 
next to the sentence that should be third; write a 4 on the line 
next to the sentence that should be fourth. 

7. The peddler walked back to town to sell his caps. 

8. He picked up the caps and put them back on his head. 


9. The monkeys copied him and threw their caps on the ground. 


10. He finally threw his cap on the ground and began to walk away. 


Group D_ Sentences 


These sentences on the story are mixed up. Write a1 on the line 
next to the sentence that should be first; write a 2 on the line 
next to the sentence that should be second; write a 3 on the line 
next to the sentence that should be third; write a 4 on the line 
next to the sentence that should be fourth. 
11. The peddler looked up in the tree and saw some monkeys 
with his caps. 
12. When he woke up, he felt to make sure his caps were straight. 
13. The caps were gone so he looked all around for them. 
14. The monkeys copied everything the peddler did. 


15. He did many things to try to get his caps back. 
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Underline the best answer. 
4.16 Look at Group A, Group B, Group C, and Group D on pages 7 and 8. 
Which group came first in the story? 

Group A Group B Group C Group D 
4.17 Which group came second in the story? 

Group A Group B Group C Group D 
4.18 Which group came third in the story? 

Group A Group B Group C Group D 
4.19 Which group came fourth in the story? 

Group A Group B Group C Group D 
oe Why does the peddler carry his wares on his head? 

a. sO people will see them 

b. so his back won't get tired 

c. so he can bend over 
S22 Why does the peddler call out "Caps for sale."? 

a. so people will hear and buy a cap 

b. so the monkeys know he is coming 

c. because he likes to 
D653 Why does the peddler put on his own cap first? 

a. because he wants to 

b. because the monkeys didn't take it 


c. because it isn't for sale 


5.4 What color caps are the most popular? 
a. blue 
b. brown 


c. red 
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«10 
This story is probably a 
a. a true story 
b. sad story 
c. make-believe story 
The peddler goes for a walk in the country 
a. because he is hungry 
b. because he wants to sleep 
c. because the monkeys are there 
The monkeys did not take any 
a. red caps 
b. checked cap 


c. yellow cap 
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RYSTROM READING COMPREHENSION TEST 


Answer Key 

PAGE 5 PAGE 8 
b 3.5 b Group C 
© 3.6 b : 4 
a oe) a : 3 
b Seo b ; 2 
b Ce, a 10 1 

30 C 

Group D 

5 PAGE 6 sei 3 
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b Sie Be e. SEEMS 2 
d yee | b 14. 5 
b 3.14 e 5% 4 

PAGE 7 PAGE 9 
al Group A 4.16 Group B 
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APPENDIX C 


TROLLING FROCEDURE” FOR; PILOT STUDY. 
AND MAIN STUDY 
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TESTING PROCEDURE FOR PILOT STUDY AND MAIN STUDY 


Hello, my name is ; 

What's your name? 

I'm interested in finding out how well children in 
grade four can answer questions about a story they have 
just finished reading. 

In a minute I'm going to give you a storybook to 
read. I want you to read the whole book silently. If 
you come to any word you don't know while you are reading 
the story ask me and I wilt tel you the word. 

(Show subject the book.) 

Here is the book. Have you read this story before? 

(Eliminate subject if he or she is familiar with 
story or has read the book.) 

Remember to ask me about any words you can't read. 
Go ahead. 

(After subject has finished reading the book, take 
Ttlandscover 10.5) 

Good, thank you. 

(Ask subject again if he had read the book before. 
Eliminate him if he now recalls reading it.) 

(Show subject the test on which his name has been 
printed.) 

Now I want you to answer some questions about the 
story you have just read. Read each question carefully. 


There will be several possible answers for each question. 
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You are to pick the one answer that is best and underline 
it with a pencil. If you don't understand how to do any 
of the questions ask me. Also if you can't read any of 
the words in the questions ask me and I will tell you. 

Go ahead with the questions. 


Thanks very much for helping me. 
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SUBJECTS' TEST COMPLETION TIMES 
AND WORDS REQUESTED 
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SUBJECTS' TEST COMPLETION TIMES AND WORDS REQUESTED 


-_eeooo SS oNOwOOOOOOTOOOOOOOOEeeelaleleoqoooeeeeZ 


Time Taken Words Requested 
Identi- (in minutes) by Subjects 
fication 
Number Group Book Test Total Book Test 
E HP 6 14 20 no words no words 
2 HP 4 ds 15 no words no words 
3 HP 4 14 18 no words no words 
4 HP 4 22 16 no words no words 
5 HP 5 aK 18 no words no words 
6 HP 5 14 19 no words no words 
A HP 4 Aiea? LS no words no words 
8 HP 4 15 19 no words no words 
9 HP 4 8 AZ. no words no words 
10 HP 5 1M 14 no words no words 
ca HP 6 gS 19 no words no words 
a2 HP 2 10 22 no words no words 
13 HP 5 5 20 no words no words 
14 HP 4 ey 15 no words no words 
LS HP 5 10 5 no words no words 
16 HNP 4 ie a5 no words no words 
Ly), HNP 2 ee ine} no words no words 
18 HNP 4 ei aS no words no words 
19 HNP 4 10 14 no words no words 
20 HNP 3 16 19 no words no words 
2 HNP 3 tte) ais) no words no words 
Ze HNP 5 23 28 no words no words 
Za HNP 8 Ls 16 no words no words 
24 HNP S 12 ES no words no words 
25 HNP 4 des 17 no words no words 
26 HNP 3 tba 14 no words no words 
20), HNP 4 Lu 15 no words na words 
28 HNP 4 9 1s) no words no words 
29 HNP 4 jet. 5 no words no words 
30 HNP 4 ss Sy, no words no words 


HP = High Pictures HNP = High No Pictures 
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Taent ae Time Taken Words Requested 
Rinoeeee (in minutes) by Subjects 
Number Group Book Test Total Book Test 
3r LP 10 Za 37 peddler, wares, 
leaned popular 
32 LP 9 25 34 no words no words 
33 LP 6 14 20 no words no words 
34 LP 6 5 2m no words no words 
35 LP 9 ZZ Sus no words no words 
36 LP 8 14 22 no words ordinary, 
wares, 
refreshed 
37 LP 7 LZ 19 no words no words 
38 LP 10 27 Sa no words no words 
39 LP 5 ite 16 no words no words 
40 LP 9 16 25 Ordinary, ‘ordinary, 
peddler, bunch 
refreshed, 
peddler 
(again) 
4l LP 6 18 24 no words no words 
42 LP 6 10 16 no words no words 
43 LP 6 19 25 wares ordinary 
44 LP 6 19 25 no words wares, 
refreshed, 
arranges 
45 LP 6 19 25 no words ordinary 
46 LNP 7 21 28 no words no words 
47 LNP 6 20 26 no words arranges 
48 LNP 8 19 2 no words no words 
49 LNP 6 15 vat no words no words 
50 LNP 5 Za 26 no words no words 
Sa LNP oe. Z2 29 no words wares 
52 LNP 5 20 25 no words headache 
5S LNP 24 30 54 *peddler, **ordinary, 
carrying wares 
54 LNP 8 Ss 2a no words no words 
55 LNP 7 22 29 ordinary ordinary, 
dzsturd wares, 
popular 
56 LNP 9 AK 22 no words no words 
57 LNP 7 18 25 tsz no words 
58 LNP 8 14 Pas ordinary no words 
59 LNP 8 26 34 no words no words 
60 LNP 5 a 16 no words no words 


*wares, own, bunch, holding, upset, fifty, even, feel, 
hungry, slowly, great, nice, thought, against, straight, 
refreshed, right, branch, finally, shaking, fingers, 


them, only, tsz. 
**qdifferent, bunch, refreshed, ordinary, held, leaned, knock. 


LP = Low Pictures LNP = Low No Pictures 
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SUBJECTS' RESPONSES TO PICTURES 


109 


& 4EQUIASA oi 


‘gudtirora ov agadédeun “ee 


110 


SUBJECTS' RESPONSES TO PICTURES 


Identi- 


£itcation 
Number Group Responses 

ue High looked quickly at all pictures before 
reading. 

2 High looked at 1/2 of pictures, very quickly 
at first 1/2 before reading, last 1/2 
after reading. 

3 High looked at pictures very quickly after 
reading. 

4 High looked quickly at each picture before 
reading. 

5 High looked at 3/4 or more of pictures very 
quickly after reading. 

6 High looked at all pictures fairly quickly 
after reading. 

7 High looked at 1/2 of pictures, very quickly 
at first 1/2 before reading, last 1/2 
after reading. 

8 High looked quickly at each picture after 

reading. 

¥) High quick glance at 3/4 of pictures before 
reading. 

10 High didn't appear to look at pictures consis- 
tently, sometimes looked after reading. 

il High looked quickly at pictures before and 
after reading each page. 

i2 High looked at all pictures very quickly 
before reading. 

ES High looked at all pictures very quickly before 
and after reading, sometimes during 
reading of pages. 

14 High looked at all pictures quickly before 
reading. 

ES High looked at all pictures quickly before 
reading. 

Su Low 2 seconds at each picture before reading, 
very quickly after each page. 

32 Low aidn't look) at ifirst 1/3) of pictures, then 
started looking after reading. 

ENS) Low looked at all pictures very quickly before 
reading. 

34 Low first 1/2 of book looked at pictures 


quickly before reading, last 1/2 some 
after. 
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Number 
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42 


43 
44 


45 


Group 


LOw 
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Low 


Low 
LOW 


Low 


Low 


Low 


Low 


Low 


Low 


rea 


Responses 


1 second at each picture before reading, 
very quickly after each page. 
looked quickly at pictures after reading. 
first 1/2 of pictures looked at quickly 
before reading, last 1/2 quickly after. 
looked at pictures before reading. 


‘looked at all pictures quickly before 


reading. 

first 1/2 of pictures looked quickly 
after, last 1/2 mostly before. 

looked at most very quickly before 
reading, studied 5 isolated for 2-3 
seconds before reading. 

first 1/2 looked very quickly before, 
last. 172 didn’t pay much attention to 
words or pictures. 

glanced very quickly at 3/4 of pictures 
after, didn't appear to look at some. 
glanced at pictures for first 1/2 after 
reading, last 1/4 looked before. 
quickly looked at pictures before reading 
each page. 
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SOURCES OF INFORMATION AVAILABLE TO 
SUBJECTS ANSWERING RRCT QUESTIONS 


Test 
Questions Rater #1 Rater #2 Rater #3 Rater #4 
71. gir; Gn, tc Gn, t gn,t 
* he 2 qn; t gn, ct gn,t gn,t 
es 3 ie trp Ep tp 
1.4 gn gn gn p,gn 
* 1.5 gn,p gn,;p gn,p gn,p 
Me 1t.6 Gn ,c +p Gn + gn,tt+p Gn,c+p 
* le. 7, t G t t 
Le eh t te c t 
Faye 2 Cig gniyt gn,t gn,t 
pre gn gn,;p ona we gn; t 
*% 2.4 Grain t,gn t,qn ton 
2 OD t i c G 
=. 2... 0 G c c ie 
a2 te G = + 
*e 25.8 t+p Gio t+p t+p 
* 259 t t t t 
* “25, 40 gn gn gn gn 
eo ftp t+p t+p tp 
ee eh 9) t+p t+p t+p 
23 t+p = t+p ie 
* 3.4 t+p t+p Ep t+p 
cae Tas) Etp t+p ttp ttp 
3h. © E ty ite t 
ee 7 E t c t 
* 3.8 Erp t+p trp t+p 
ee) t+p t+p ane) t+p 
3.10 t+p t tt+p ttp 
cyaeele Cip t+p t+p c 
Se3% 2 t+p t+p t+p t+p 
(PAS nS} trp t+p ttp t+p 
* 3.14 Crp tp t+p t+p 


complete rater agreement 


t = text alone 
p = picture or pictures alone 
ttp. = texh, and, pactune (Ss) 
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Test 
Questions Rater #1 Rater #2 Rater #3 Rater #4 
4.1 : t t ttp 
4.2 t t t t+p 
cla Waa t+tp trp Ep t+p 
* 44 t+p t+p t+p t+p 
* 4.5 tc ie 1s c 
aA. 5.6 t+pD t+p t+p t+p 
cae! oat | t+p ttp t+p t+p 
4.8 te o ttp t+p 
* 4.9 t+p t+p ttp t+p 
4.10 t “e t+p t 
ean t+p t+p t+p t+p 
4.12 t ce ic EOD 
e413 t+p t+p ED t+p 
* 4,14 t+p Erp t+p t+p 
coma We Ns) t+p trp t+p t+p 
4.16 Vee t £ ttp 
AAT t+p t c ttp 
4.18 t+p = t+p t+p 
4.19 t+p te t+p t+p 
Sy al gn gn,p gn tt+p 
Si. 2 gn gn gn c 
5.3 gn gn gn t 
5.4 t re t t+tp 
6.1 gn gn gn gn,ttp 
AAO 2 2 ie t t 
* 6.3 t+p ttp ttp t+p 


complete rater agreement 


t = text alone 
p = picture or pictures alone 
ttp = text and picture(s) 
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